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query various sources of information on the web and obtain 
relevant stories about the current meeting to send back to the 
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SYSTEM, METHOD AND ARTICLE OF utilized as input to the agent system. Then, the agent system 

MANUFACTURE FOR CREATING A parses the input meeting text to extract its various compo- 

FILTERED INFORMATION SUMMARY nents such as title, body, participants, location, time etc. The 

BASED ON MULTIPLE PROFILES OF EACH system also performs pattern matching to identify particular 

SINGLE USER 5 appropriate information. This information is utilized to 

query various sources of information on the web and obtain 

FIELD OF THE INVENTION relevant stories about the current meeting to send back to the 

calendaring system. 

The present invention relates to agent based systems and 

more particularly to a system which automatically obtains 1Q DESCRIPTION OF THE DRAWINGS 
information based on scanned information from a target 

• tem The foregoing and other objects, aspects and advantages 

are better understood from the following detailed description 

BACKGROUND OF THE INVENTION of a preferred embodiment of the invention with reference to 

the drawings, in which: 

Agent based technology has become increasingly impor- is p, a j fa B Wock dl of a KpteseaUltive hardware 

tant for _use with applications designed to interact w,th a user enviromnent ta accordance with a preferred embodiment; 

for performing various computer based tasks in foreground . 

and background modes. Agent software comprises computer F J G - \ * a flowchart of the system in accordance with a 

programs that are set on behalf of users to perform routine, preferred embodiment; 

tedious and time-consuming tasks. To be useful to an 20 FIG. 3 is a flowchart of a parsing unit of the system in 

individual user, an agent must be personalized to the indi- accordance with a preferred embodiment; 

vidual user's goals, habits and preferences. Thus, there FIG. 4 is a flowchart for pattern matching in accordance 

exists a substantial requirement for the agent to efficiently with a preferred embodiment; 

and effectively acquire user-specific knowledge from the FIG. 5 is a flowchart for a search unit in accordance with 

user and utilize it to perform tasks on behalf of the user. 25 a p re f erre d embodiment; 

The concept of agency, or the user of agents, is well pic. 6 is a flowchart for overall system processing in 

established. An agent is a person authorized by another accordance with a preferred embodiment; 

person, typically referred to as a principal, to act on behalf nG ? fc a of fc ocessin ^ accordance 

of the prmcipal. In this manner the principal empowers the ^ a ^ cmbodimcnt 

agent to perform any of the tasks that the principal is -* u . • 

unwilling or unable to perform. For example, an insurance FIG * 8 18 a flowchart of meeting record processing m 

agent may handle all of the insurance requirements for a accordance with a preferred embodiment; 

principal, or a talent agent may act on behalf of a performer FIG. 9 is a block diagram of process flow of a pocket 

to arrange concert dates. bargain finder in accordance with a preferred embodiment; 

With the advent of the computer, a new domain for 35 FIGS. 10A-10B are flowcharts depicting the logic asso- 

employing agents has arrived. Significant advances in the ciated with creating a customized content web page in 

realm of expert systems enable computer programs to act on accordance with a preferred embodiment; 

behalf of computer users to perform routine, tedious and FIG. U is a flowchart depicting the detailed logic asso- 

other time-consuming tasks. These computer programs are ciated with retrieving user-centric content in accordance 

referred to as "software agents." with a preferred embodiment; 

Moreover, there has been a recent proliferation of com- FIG. 12 is a data model of a user profile in accordance 

puter and communication networks. These networks permit with a preferred embodiment; 

a user to access vast amounts of information and services FIG. 13 is a persona data model in accordance with a 

without, essentially, any geographical boundaries. Thus, a 45 preferred embodiment; 

software agent has a rich environment to perform a large p IG 14 ± s m intention data model in accordance with a 

number of tasks on behalf of a user. For example, it is now preferred embodiment; 

possible for an agent to make an airline reservation, pur- p]Q. 15 is a flowchart of the processing for generating an 

chase the ticket, and have the ticket delivered directly to a >s ^ accordance ^ a fcrred 

user. Similarly, an agent could scan the Internet and obtain 5Q embodiment- 

information ranging from the latest sports or news to a „ , _ . . . . t . t 

particular graduate thesis in applied physics. Current solu- , 16 » a ° f f the lo 8 lc that ^rmmes the 

dons fail to apply agent technology to obtain information P ^lS^rltedtoL™ " ^ ™ 

from a target article and utilize a communication network to P re err em 0 > 

take user directed action based on the information from the „ FIG. 17 is a flowchart of the logic for accessing the 

target article centrally stored profile in accordance with a preferred 

embodiment; 

SUMMARY OF THE INVENTION FIG. 18 is a flowchart of the interaction logic between a 

, A _ r ,t_,- 4 c user and the integrator for a particular supplier in accordance 

According to a broad aspect or a preferred embodiment 01 _ , , . j* . 

, . A . & 4 • - i_ * * * * c r with a preferred embodiment; 

the invention, a system assists in obtammg information from 60 r 7 

an article of interest and utilizes the information to take user FIG - 19 15 a flowchart of the agent processing for gener- 

directed action based on the information from the target atin S a verbal summary in accordance with a preferred 

article. The system obtains input text in character form embodiment; 

indicative of the target meeting from the a calendar program FIG- 20 illustrates a display login in accordance with a 

that includes the time of the meeting. As the time of the 65 preferred embodiment; 

meeting approaches, the calendar program is queried to FIG. 21 illustrates a managing daily logistics display in 

obtain the text of the target event and that information is accordance with a preferred embodiment; 
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FIG. 22 illustrates a user main display in accordance with procedures, it can be visualized as a self-sufficient compo- 

a preferred embodiment; nent that does not require other additional structures, pro- 

F1G. 23 illustrates an agent interaction display in accor- cedures or data to perform its specific task. OOP, therefore, 

dance with a preferred embodiment; view s a computer program as a collection of largely autono- 

FIG. 24 is a block diagram of an active knowledge 5 m <"» components, called objects, each of which is respon- 

management system in accordance with a preferred embodi- siblc for a s ^ cific ta f k ' ^ of Paging data, 

mcnt J structures, and procedures together in one component or 

, , module is called encapsulation. 
FIG. 25 is a block diagram of a back end server in 

accordance with a preferred embodiment; 10 , In OOP component are reusable software mod- 

r . . 10 ules which present an interface that conforms to an object 

FIG. 26 is a block diagram of a magic wall in accordance modd and whicQ are accessed at ma . iimc through a C om- 

with a preferred embodiment; poncnt i ntcgrat ; on architecture. A component integration 

FIG. 27 illustrates a user reading a magazine with an architecture is a set of architecture mechanisms which allow 

Icode in accordance with a preferred embodiment; software modules in different process spaces to utilize each 

FIG. 28 illustrates a user scanning a target item indicia in 15 others capabilities or functions. This is generally done by 

accordance with a preferred embodiment; assuming a common component object model on which to 

FIGS. 29 to 37 depict a handheld computer with screen build the architecture, 

displays in accordance with a preferred embodiment; and It is worthwhile to differentiate between an object and a 

FIG. 38 depicts the architecture and process flow in class of objects at this point. An object is a single instance 

accordance with a preferred embodiment. of ^ class of objects, which is often just called a class. A 

class of objects can be viewed as a blueprint, from which 

DETAILED DESCRIPTION many objects can be formed. 

A preferred embodiment of a system in accordance with OOP allows the programmer to create an object that is a 

the present invention is preferably practiced in the context of 25 P^ of another object For example, the object representing 

a personal computer such as an IBM compatible personal a P^ 011 engine is said to have a composition-relationship 

computer, Apple Macintosh computer or UNIX based work- with the object representing a piston. In reality, a piston 

station. A representative hardware environment is depicted engine comprises a piston, valves and many other compo- 

in FIG. 1, which illustrates a typical hardware configuration nentf H the fact that a piston is an element of a piston engine 

of a workstation in accordance with a preferred embodiment 30 can be logically and semantically represented in OOP by two 

having a central processing unit 110, such as a objects. 

microprocessor, and a number of other units interconnected OOP also allows creation of an object that "depends 

via a system bus 112. The workstation shown in FIG. 1 from" another object. If there are two objects, one repre- 

includes a Random Access Memory (RAM) 114, Read Only senting a piston engine and the other representing a piston 

Memory (ROM) 116, an I/O adapter 118 for connecting 35 engine wherein the piston is made of ceramic, then the 

peripheral devices such as disk storage units 120 to the bus relationship between the two objects is not that of compo- 

112, a user interface adapter 122 for connecting a keyboard sition. A ceramic piston engine does not make up a piston 

124, a mouse 126, a speaker 128, a microphone 132, and/or engine. Rather it is merely one kind of piston engine that has 

other user interface devices such as a touch screen (not one more limitation than the piston engine; its piston is made 

shown) to the bus 112, communication adapter 134 for 40 of ceramic. In this case, the object representing the ceramic 

connecting the workstation to a communication network piston engine is called a derived object, and it inherits all of 

(e.g., a data processing network) and a display adapter 136 the aspects of the object representing the piston engine and 

for connecting the bus 112 to a display device 138. The adds further limitation or detail to it. The object representing 

workstation typically has resident thereon an operating the ceramic piston engine "depends from" the object repre- 

system such as the Microsoft Windows NT or Windows/95 45 senting the piston engine. The relationship between these 

Operating System (OS), the IBM OS/2 operating system, the objects is called inheritance. 

MAC OS, or UNIX operating system. Those skilled in the When the object or class representing the ceramic piston 

art will appreciate that the present invention may also be engine inherits all of the aspects of the objects representing 

implemented on platforms and operating systems other than the piston engine, it inherits the thermal characteristics of a 

those mentioned. 50 standard piston defined in the piston engine class. However, 

Apreferred embodiment is written using JAVA, C, and the the ceramic piston engine object overrides these ceramic 

C++ language and utilizes object oriented programming specific thermal characteristics, which are typically different 

methodology. Object oriented programming (OOP) has from those associated with a metal piston. It skips over the 

become increasingly used to develop complex applications. original and uses new functions related to ceramic pistons. 

As OOP moves toward the mainstream of software design 55 Different kinds of piston engines have different 

and development, various software solutions require adap- characteristics, but may have the same underlying functions 

tation to make use of the benefits of OOP. A need exists for associated with it (e.g., how many pistons in the engine, 

these principles of OOP to be applied to a messaging ignition sequences, lubrication, etc.). To access each of these 

interface of an electronic messaging system such that a set functions in any piston engine object, a programmer would 

of OOP classes and objects for the messaging interface can eo call the same functions with the same names, but each type 

be provided. of piston engine may have different/overriding implemen- 

OOP is a process of developing computer software using tations of functions behind the same name. This ability to 
objects, including the steps of analyzing the problem, hide different implementations of a function behind the same 
designing the system, and constructing the program. An name is called polymorphism and it greatly simplifies corn- 
object is a software package that contains both data and a 65 munication among objects. 

collection of related structures and procedures. Since it With the concepts of composition-relationship, 

contains both data and a collection of structures and encapsulation, inheritance and polymorphism, an object can 
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represent just about anything in the real world. In fact, our 
logical perception of the reality is the only limit on deter- 
mining the kinds of things that can become objects in 
object-oriented software. Some typical categories are as 
follows: 

Objects can represent physical objects, such as automo- 
biles in a traffic-flow simulation, electrical components 
in a circuit-design program, countries in an economics 
model, or aircraft in an air-traffic-control system. 

Objects can represent elements of the computer-user 
environment such as windows, menus or graphics 
objects. 

An object can represent an inventory, such as a personnel 
file or a table of the latitudes and longitudes of cities. 

An object can represent user-defined data types such as 
time, angles, and complex numbers, or points on the 
plane. 

With this enormous capability of an object to represent 
just about any logically separable matters, OOP allows the 
software developer to design and implement a computer 
program that is a model of some aspects of reality, whether 
that reality is a physical entity, a process, a system, or a 
composition of matter. Since the object can represent 
anything, the software developer can create an object which 
can be used as a component in a larger software project in 
the future. 

If 90% of a new OOP software program consists of 
proven, existing components made from preexisting reus- 
able objects, then only the remaining 10% of the new 
software project has to be written and tested from scratch. 
Since 90% already came from an inventory of extensively 
tested reusable objects, the potential domain from which an 
error could originate is 10% of the program. As a result, 
OOP enables software developers to build objects out of 
other, previously built, objects. 

This process closely resembles complex machinery being 
built out of assemblies and sub -assemblies. OOP 
technology, therefore, makes software engineering more like 
hardware engineering in that software is built from existing 
components, which are available to the developer as objects. 
All this adds up to an improved quality of the software as 
well as an increased speed of its development. 

Programming languages are beginning to fully support the 
OOP principles, such as encapsulation, inheritance, 
polymorphism, and composition-relationship. With the 
advent of the C++ language, many commercial software 
developers have embraced OOP. C++ is an OOP language 
that offers a fast, machine -executable code. Furthermore, 
C++ is suitable for both commercial-application and 
systems-programming projects. For now, C++ appears to be 
the most popular choice among many OOP programmers, 
but there is a host of other OOP languages, such as 
Smalltalk, common lisp object system (CLOS), and Eiffel. 
Additionally, OOP capabilities are being added to more 
traditional popular computer programming languages such 
as Pascal. 

The benefits of object classes can be summarized, as 
follows: 

Objects and their corresponding classes break down com- 
plex programming problems into many smaller, sim- 
pler problems. 

Encapsulation enforces data abstraction through the orga- 
nization of data into small, independent objects that can 
communicate with each other. Encapsulation protects 
the data in an object from accidental damage, but 
allows other objects to interact with that data by calling 
the object's member functions and structures. 



20 



25 



30 



Subclassing and inheritance make it possible to extend 
and modify objects through deriving new kinds of 
objects from the standard classes available in the sys- 
tem. Thus, new capabilities are created without having 
5 to start from scratch. 

Polymorphism and multiple inheritance make it possible 
for different programmers to mix and match character- 
istics of many different classes and create specialized 
objects that can still work with related objects in 
!0 predictable ways. 

Class hierarchies and containment hierarchies provide a 
flexible mechanism for modeling real-world objects 
and the relationships among them. 
Libraries of reusable classes are useful in many situations, 
15 but they also have some limitations. For example: 

Complexity. In a complex system, the class hierarchies 
for related classes can become extremely confusing, 
with many dozens or even hundreds of classes. 
Flow of control. A program written with the aid of class 
libraries is still responsible for the flow of control 
(i.e., it must control the interactions among all the 
objects created from a particular library). The pro- 
grammer has to decide which functions to call at 
what times for which kinds of objects. 
Duplication of effort. Although class libraries allow 
programmers to use and reuse many small pieces of 
code, each programmer puts those pieces together in 
a different way. Two different programmers can use 
the same set of class libraries to write two programs 
that do exactly the same thing but whose internal 
structure (i.e., design) may be quite different, 
depending on hundreds of small decisions each pro- 
grammer makes along the way. Inevitably, similar 
pieces of code end up doing similar things in slightly 
35 different ways and do not work as well together as 

they should. 

Class libraries are very flexible. As programs grow more 
complex, more programmers are forced to reinvent basic 
solutions to basic problems over and over again. A relatively 

40 new extension of the class library concept is to have a 
framework of class libraries. This framework is more com- 
plex and consists of significant collections of collaborating 
classes that capture both the small scale patterns and major 
mechanisms that implement the common requirements and 

45 design in a specific application domain. They were first 
developed to free application programmers from the chores 
involved in displaying menus, windows, dialog boxes, and 
other standard user interface elements for personal comput- 
ers. 

50 Frameworks also represent a change in the way program- 
mers think about the interaction between the code they write 
and code written by others. In the early days of procedural 
programming j the programmer called libraries provided by 
the operating system to perform certain tasks, but basically 

55 the program executed down the page from start to finish, and 
the programmer was solely responsible for the flow of 
control. This was appropriate for printing out paychecks, 
calculating a mathematical table, or solving other problems 
with a program that executed in just one way. 

60 The development of graphical user interfaces began to 
turn this procedural programming arrangement inside out. 
These interfaces allow the user, rather than program logic, to 
drive the program and decide when certain actions should be 
performed. Today, most personal computer software accom- 

65 plishes this by means of in event loop which monitors the 
mouse, keyboard, and other sources of external events and 
calls the appropriate parts of the programmer's code accord- 
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ing to actions that the user performs. The programmer no 
longer determines the order in which events occur. Instead, 
a program is divided into separate pieces that are called at 
unpredictable times and in an unpredictable order. By relin- 
quishing control in this way to users, the developer creates 
a program that is much easier to use. Nevertheless, indi- 
vidual pieces of the program written by the developer still 
call libraries provided by the operating system to accomplish 
certain tasks, and the programmer must still determine the 
flow of control within each piece after being called by the 
event loop. Application code still "sits on top of the system. 

Even event loop programs require programmers to write 
a lot of code that should not need to be written separately for 
every application. The concept of an application framework 
carries the event loop concept further. Instead of dealing 
with all the nuts and bolts of constructing basic menus, 
windows, and dialog boxes and then making these things all 
work together, programmers using application frameworks 
start with working application code and basic user interface 
elements in place. Subsequently, they build from there by 
replacing some of the generic capabilities of the framework 
with the specific capabilities of the intended application. 

Application frameworks reduce the total amount of code 
that a programmer has to write from scratch. However, 
because the framework is really a generic application that 
displays windows, supports copy and paste, and so on, the 
programmer can also relinquish control to a greater degree 
than event loop programs permit. The framework code takes 
care of almost all event handling and flow of control, and the 
programmer's code is called only when the framework 
needs it (e.g., to create or manipulate a proprietary data 
structure). 

A programmer writing a framework program not only 
relinquishes control to the user (as is also true for event loop 
programs), but also relinquishes the detailed flow of control 
within the program to the framework. This approach allows 
the creation of more complex systems that work together in 
interesting ways, as opposed to isolated programs, having 
custom code, being created over and over again for similar 
problems. 

Thus, as is explained above, a framework basically is a 
collection of cooperating classes that make up a reusable 
design solution for a given problem domain. It typically 
includes objects that provide default behavior (e.g., for 
menus and windows), and programmers use it by inheriting 
some of that default behavior and overriding other behavior 
so that the framework calls application code at the appro- 
priate times. 

There are three main differences between frameworks and 
class libraries: 

Behavior versus protocol. Class libraries are essentially 
collections of behaviors that you can call when you 
want those individual behaviors in your program. A 
framework, on the other hand, provides not only behav- 
ior but also the protocol or set of rules that govern the 
ways in which behaviors can be combined, including 
rules for what a programmer is supposed to provide 
versus what the framework provides. 

Call versus override. With a class library, the code the 
programmer instantiates objects and calls their member 
functions. It's possible to instantiate and call objects in 
the same way with a framework (i.e., to treat the 
framework as a class library), but to take full advantage 
of a framework's reusable design, a programmer typi- 
cally writes code that overrides and is called by the 
framework. The framework manages the flow of con- 
trol among its objects. Writing a program involves 
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dividing responsibilities among the various pieces of 
software that are called by the framework rather than 
specifying how the different pieces should work 
together. 

Implementation versus design. With class libraries, pro- 
grammers reuse only implementations, whereas with 
frameworks, they reuse design. A framework embodies 
the way a family of related programs or pieces of 
software work. It represents a generic design solution 
that can be adapted to a variety of specific problems in 
a given domain. For example, a single framework can 
embody the way a user interface works, even though 
two different user interfaces created with the same 
framework might solve quite different interface prob- 
lems. 

Thus, through the development of frameworks for solu- 
tions to various problems and programming tasks, signifi- 
cant reductions in the design and development effort for 
software can be achieved. A preferred embodiment of the 
invention utilizes HyperText Markup Language (HTML) to 
implement documents on the Internet together with a 
general-purpose secure communication protocol for a trans- 
port medium between the client and the Newco. HTTP or 
other protocols could be readily substituted for HTML 
without undue experimentation. Information on these prod- 
ucts is available in T. Berners-Lee, D. Connoly, "RFC 1866: 
Hypertext Markup Language — 2.0 " (November 1995); and 
R. Fielding, H, Frystyk, T. Berners-Lee, J. Gettys and J. C. 
Mogul, "Hypertext Transfer Protocol — HTTP/1 . 1 : HTTP 
Working Group Internet Draft" (May 2, 1996). HTML is a 
simple data format used to create hypertext documents that 
are portable from one platform to another. HTML docu- 
ments are SGML documents with generic semantics that are 
appropriate for representing information from a wide range 
of domains. HTML has been in use by the World-Wide Web 
global information initiative since 1990. HTML is an appli- 
cation of ISO Standard 8879:1986 Information Processing 
Text and Office Systems; Standard Generalized Markup 
Language (SGML). 

To date, Web development tools have been limited in their 
ability to create dynamic Web applications which span from 
client to server and interoperate with existing computing 
resources. Until recently, HTML has been the dominant 
technology used in development of Web-based solutions. 
However, HTML has proven to be inadequate in the fol- 
lowing areas: 

Poor performance; 

Restricted user interface capabilities; 

Can only produce static Web pages; 

Lack of interoperability with existing applications and 
data; and 

Inability to scale. 

Sun Microsystem's Java language solves many of the 
client-side problems by: 

Improving performance on the client side; 
Enabling the creation of dynamic, real-time Web appli- 
cations; and 

Providing the ability to create a wide variety of user 
interface components. 

With Java, developers can create robust User Interface 
(UI) components. Custom "widgets" (e.g. real-time stock 
tickers, animated icons, etc) can be created, and client-side 
performance is improved. Unlike HTML, Java supports the 
notion of client-side validation, offloading appropriate pro- 
cessing onto the client for improved performance. Dynamic, 
real-time Web pages can be created. Using the above- 
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mentioned custom UI components, dynamic Web pages can gather to prepare the user for the target meeting. In accor- 

also be created. dance with a preferred embodiment, the information is 

Sun's Java language has emerged as an industry- stored in a file that is obtained via selection from a link 

recognized language for "programming the Internet." Sun imbedded in the calendar system, 

defines Java as: "a simple, object-oriented, distributed, 5 

interpreted, robust, secure, architecture-neutral, portable, Program Organization 

high-performance, multithreaded, dynamic, buzzword- . 

compliant, general-purpose programming language. Java A computer program in accordance with a preferred 
supports programming for the Internet in the form of embodiment is organized in five distinct modules: BRMain, 
platform-independent Java applets." Java applets are small, 10 BF.Parse, Background Finder.Error, BFPatternMatching 
specialized applications that comply with Sun's Java Appli- and BESearch. TTiere is also a frmMain which provides a 
cation Programming Interface (APT) allowing developers to user interface used only for debugging purposes. The 
add "interactive content** to Web documents (e.g. simple executable programs in accordance with a preferred embodi- 
animations, page adornments, basic games, etc.). Applets menl never execute ™& lhe ™* T interface and should only 
execute within a Java-compatible browser (e.g. Netscape 15 ^turn to the calendaring system through Microsoft's Win- 
Navigator) by copying code from the server to client. From sock control. A preferred embodiment of the system 
a language standpoint, Java's core feature set is based on executes in two different modes which can be specified 
C++. Sun's Java literature states that Java is basically "C++, undcr the command line sent to it by the calendaring system 
with extensions from Objective C for more dynamic method When the system runs m simple mode, it executes a keyword 
resolution" 20 <l uer y t0 submit to external search engines. When executed 
Another technology that provides similar function to ™ complex mode, the system performs pattern matching 
JAVA is provided by Microsoft and ActiveX Technologies, t> e &> re il forms a W to be sent to a search engine, 
to give developers and Web designers wherewithal to build 

dynamic content for the Internet and personal computers. Data Structures 

ActiveX includes tools for developing animation^-D vir- 25 ^ {q acc0fdance ^ a ferred embodiment 

tual reality, video and other multimedia content. The tools ^ ^ defined structures: 

use Internet standards, work on multiple platforms, and are 

being supported by over 100 companies. The group's build- 1- TMeetingRecord; 

ing blocks are called ActiveX Controls, small, fast compo- 2. TPatternElement; and 

nents that enable developers to embed parts of software in 30 _ ™ n 

, t r ,,t*t~*mt\ * ** v 3. lPatternKecord. 

hypertext markup language (HTML) pages. ActiveX Con- _ . ^ . . J 

trols work with a variety of programming languages includ- ™* user-defined structure, tMeetingRecord, is used to store 

ing Microsoft Visual C++, Borland Delphi, Microsoft Visual a11 the pertinent information concerning a single meeting. 

Basic programming system and, in the future, Microsoft's ™* L mcludes *f '! D > a ° on &™} ^option of the 

development tool for Java, code named "Jakarta." ActiveX 35 meetlfl g> the extracted list of keywords from the title and 

Technologies also includes ActiveX Server Framework, body of meeting etc. It is important to note that only one 

allowing developers to create server applications. One of mcetl ^ record is created per instance of the system in 

ordinary skill in the art readily recognizes that ActiveX accordance with a preferred embodiment. Tins is because 

could be substituted for JAVA without undue experimenta- eacb ^ the svstcin 15 s P awncd . to ™ upcoming 

tion to practice the invention. 40 meeting, it is assigned a task to retrieve information for only 

In accordance with a preferred embodiment, Background- one meetin g- Therefore, the meeting record created corre- 

Finder (BF) is implemented as an agent responsible for s P° nds to the currcnt meetm S examined. ParseMeetingText 

preparing an individual for an upcoming meeting by helping populates this meeting record and it is then passed around to 

him/her retrieve relevant information about the meeting P rovide ^formation about the meeting to other functions, 

from various sources. BF receives input text in character 45 ^ GoPatternMatch can bind any values to a particular 

form indicative of the target meeting. The input text is meeting field, the corresponding entries in the meeting 

generated in accordance with a preferred embodiment by a record is also updated. The structure of tMeetingRecord with 

calendar program that includes the time of the meeting. As each field described in parentheses is provided below m 

the time of the meeting approaches, the calendar program is accordance with a preferred embodiment, 

queried to obtain the text of the target event and that 50 

information is utilized as input to the agent. Then, the agent 

parses the input meeting text to extract its various compo- ^ hlic tMeetingRecord 

nents such as title, body, participants, location, time etc. The sUserfD As string (user id given by Munin) 

system also performs pattern matching to identify particular sHUeOrig As string (original non stop listed title we need to 

meeting fields in a meeting text. This information is utilized 55 keep around to send back to Munin) 

° . r • r 4 . , _ 1 sTitleKW As String (stoplistcd title with only keywords) 

to query various sources of information on the web and sBodyKW M ^ \ sto P pVls u* body with only keywords) 

Obtain relevant Stories about the current meeting to send sCompanyO As String (companys identified in tide or body through 

back to the calendaring system. For example, if an indi- pattern matching) 

vidual has a meeting with Netscape and Microsoft to talk ^P^O As siring (topics identified in due or body through 

about their disputes, and would obtain this initial informa- 60 sPcoplc() M StHng JJ^alSrf in tide or body through 

tion from the calendaring system. It will then parse out the pattern matching) 

text to realize that the companies in the meeting are sWbenO As String (time identified in tide or body through 

"Netscape" and "Microsoft" and the topic is "disputes." ^ P attcrn . . t u A u v 

. r . , f . - f _ s Where 0 As String (location identified in title or body through 

Then, the system queries the web for relevant information v & p & \t&m matching) 

concerning the topic. Thus, in accordance with an objective 65 S Location As string (location as passed in by Munin) 

of the invention, the system updates the calendaring system ' sTime As String (time as passed in by Munin) 
and eventually the user with the best information it can 
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-continued 



sParticipantsO As String (all participants engaged as passed in by 
Munin) 

sMeetingText As String (the original meeting text wfo userid) 
End Type 



There are two other structures which are created to hold 
each individual pattern utilized in pattern matching. The 
record tAPatternRecord is an array containing all the 
components/elements of a pattern. The type tAPatternEle- 
ment is an array of strings which represent an element in a 
pattern. Because there may be many "substitutes" for each 
element, we need an array of strings to keep track of what 
all the substitutes are. The structures of tAPattemElement 
and tAPatternRecord are presented below in accordance 
with a preferred embodiment. 

Public Type tAPattemElement 

elementArray( ) As String 
End Type 

Public Type tAPatternRecord 
pattemArray( ) As tAPattemElement 
End Type 

Common User Denned Constants 

Many constants are defined in each declaration section of 
the program which may need to be updated periodically as 
part of the process of maintaining the system in accordance 
with a preferred embodiment. The constants are accessible 
to allow dynamic configuration of the system to occur as 
updates for maintaining the code. 

Included in the following tables are lists of constants firom 
each module which I thought are most likely to be modified 
from time to time. However, there are also other constants 
used in the code not included in the following list. It does not 
mean that these non-included constants will never be 
chanced. It means that they will chance much less fre- 
quently. 

For the Main Module (BF.Main): 



CONSTANT PRESET VALUE USE 

5 OUTPARAM_S EPARAT Define delimiter for 

OR separating out different 

portions of the output. 
The separator is for 
delimiting the msg 
type, the user id, the 

10 meeting title and the 

beginning of the actual 
stories retrieved. 



For the Search Module (BKSearch): 

IS 







CURRENT 






CONSTANT 


VALUE 


USE 


20 


PAST_NDAYS 


5 


Define number of days you 
want to look back for 
AltaVista articles. Doesn't 
really matter now because we 
aren't really doing a news 
search in alta vista. We want 


25 






all info. 




CONNECTOR_AV_URL 


"+AND+" 


Define how to connect 
keywords. We want all our 
keywords in the string so 
for now use AND. If you 
want to do an OR or 


30 






something, just change 






connector. 




CONNECTO R__NP_URL 


"+AND+" 


Define how to connect 
keywords. We want all oui 
keywords in the string so 
for now use AND. If you 
want to do an OR or 


35 






something, just change 
connector. 




NUM_NP_STORIES 


3 


Define the number of stories 
to return back to Munin from 
NewsPage. 




NUM_AV„STORffiS 


3 


Define the number of stories 


40 






to return back to Munin from 
AltaVista. 



For the Parse Module (BF.Parse): 



CONSTANT 



PRESET VALUE USE 



MSGTOMUNIN_TYPE 



IP _ADDRESS_MUN1N "10. 2.1 00.43" 



PORT_MUNIN 
TIMEOUT_AV 
TIMEOUT_NP 
CMD_SEPARATOR 



7777 



60 



Define the message 
number used to identify 
messages between BF 
and Munin 

Define the IP address of 
the machine in which 
Munin and BF are 
running on so they can 
transfer data through 
UDP. 

Define the remote port in 
which we are operating 
on. 

Define constants for 
setting time out in inet 
controls 

Define constants for 
setting time out 
in inet controls 
Define delimiter to tell 
which part of Munin 's 
command represents the 
beginning of our input 
meeting text 



CONSTANT 



CURRENT 
VALUE 



USE 



FORTION_SEPARATOR 



50 



PARTI CI PANT_S EPARATO R "f* 



60 



Define the separator 
between different 
portions of the meeting 
text sent in by Munin. 
For example in 
"09::Meet with 
Chad::about 
life-ChadlDenise::::::". 

is the 
separator between 
different parts of 
the meeting text. 
Define the separator 
between each participant 
in the participant list 
portion of the original 
meeting text. 
Refer to example above. 



For Pattern Matching, Module (BFPatternMatch): There 
are no constants in this module which require frequent 
updates. 



01/28/2003, EAST Version: 1.03.0007 



US 6,202,062 Bl 



13 

General Process Flow 
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The best way to depict the process flow and the coordi- 
nation of functions between each other is with the five 
flowcharts illustrated in FIGS. 2 to 6. FIG. 2 depicts the 
overall process flow in accordance with a preferred embodi- 
ment. Processing commences at the top of the chart at 
function block 200 which launches when the program starts. 
Once the application is started, the command line is parsed 
to remove the appropriate meeting text to initiate the target 
of the background find operation in accordance with a 
preferred embodiment as shown in function block 210. A 
global stop list is generated after the target is determined as 
shown in function block 220. Then, all the patterns that are 
utilized for matching operations are generated as illustrated 
in function block 230. Then, by tracing through the chart, 
function block 200 invokes GoBF 240 which is responsible 
for logical processing associated with wrapping the correct 
search query information for the particular target search 
engine. For example, function block 240 flows to function 
block 250 and it then calls GoPattemMatch as shown in 
function block 260. To see the process flow of 
GoPattemMatch, we swap to the diagram titled "Process 
Flow for BF's Pattern Matching Unit." 

One key thing to notice is that functions depicted at the 
same level of the chart are called by in sequential order from 
left to right (or top to bottom) by their common parent 
function. For example, Main 200 calls Process Command- 
Line 210, then CreateStopListist 220, then Create Patterns 
230, then GoBackgroundFinder 240. FIGS. 3 to 6 detail the 
logic for the entire program, the parsing unit, the pattern 
matching unit and the search unit respectively. FIG. 6 details 
the logic determinative of data flow of key information 
through BackgroundFinder, and shows the functions that are 
responsible for creating or processing such information. 

Detailed Search Architecture with Simple Query 
Mode 



Search Alt a Vista 



Function Block 270 of FIG. 2 
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The Alta Vista search engine utilizes the identifies and 
returns general information about topics related to the cur- 
rent meeting as shown in function block 270 of FIG. 2, The 45 
system in accordance with a preferred embodiment takes all 
the keywords from the title portion of the original meeting 
text and constructs an advanced query to send to Alta Vista. 
The keywords are logically combined together in the query. 
The results are also ranked based on the same set of 50 
keywords. One of ordinary skill in the art will readily 
comprehend that a date restriction or publisher criteria could 
be facilitated on the articles we want to retrieve. A set of top 
ranking stories are returned to the calendaring system in 
accordance with a preferred embodiment 55 

News Page 

Function Block 275 of FIG. 2 



The NewsPage search system is responsible for giving us 
the latest news topics related to a target meeting. The system 
takes all of the keywords from the title portion of the original 
meeting text and constructs a query to send to the NewsPage 
search engine. The keywords are logically combined 
together in the query. Only articles published recently are 
retrieved. The Newspage search system provides a date 
restriction criteria that is settable by a user according to the 
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user's preference. The top ranking stories are returned to the 
calendaring system. 

FIG. 3 is a user profile data model in accordance with a 
preferred embodiment. Processing commences at function 
block 300 which is responsible for invoking the program 
from the main module. Then, at function block 310, a 
wrapper function is invoked to prepare for the keyword 
extraction processing in function block 320. After the key- 
words are extracted, then processing flows to function block 
330 to determine if the delimiters are properly positioned. 
Then, at function block 340, the number of words in a 
particular string is calculated and the delimiters for the 
particular field are and a particular field from the meeting 
text is retrieved at function block 350. Then, at function 
block 380, the delimiters of the string are again checked to 
assure they are placed appropriately. Finally, at function 
block 360, the extraction of each word from the title and 
body of the message is performed a word at a time utilizing 
the logic in function block 362 which finds the next closest 
word delimiter in the input phrase, function block 364 which 
strips unnecessary materials from a word and function block 
366 which determines if a word is on the stop list and returns 
an error if the word is on the stop list. 

Pattern Matching in Accordance with a Preferred 
Embodiment 

The limitations associated with a simple searching 
method include the following: 

1. Because it relies on a stoplist of unwanted words in 
order to extract from the meeting text a set of 
keywords, it is limited by how comprehensive the 
stoplist is. Instead of trying to figure out what parts of 
the meeting text we should throw away, we should 
focus on what parts of the meeting text we want. 

2. A simple search method in accordance with a preferred 
embodiment only uses the keywords from a meeting 
title to form queries to send to Alta Vista and News- 
Page. This ignores an alternative source of information 
for the query, the body of the meeting notice. We cannot 
include the keywords from the meeting body to form 
our queries because this often results in queries which 
are too long and so complex that we often obtain no 
meaningful results. 

3. There is no way for us to tell what each keyword 
represents. For example, we may extract "Andy" and 
"Grove" as two keywords. However, a simplistic 
search has no way knowing that "Andy Grove" is in 
fact a person's name. Imagine the possibilities if we 
could somehow intelligently guess that "Andy Grove" 
is a person's name. We can find out if he is an Andersen 
person and if so what kind of projects he's been on 
before etc. etc. 

4. In summary, by relying solely on a stoplist to parse out 
unnecessary words, we suffer from "information over- 
load". 

Pattern Matching Overcomes these Limitations in 
Accordance with a Preferred Embodiment 

Here's how the pattern matching system can address each 
of the corresponding issues above in accordance with a 
preferred embodiment. 

1. By doing pattern matching, we match up only parts of 
the meeting text that we want and extract those parts. 

2. By performing pattern matching on the meeting body 
and extracting only the parts from the meeting body 
that we want. Our meeting body will not go to complete 
waste then. 
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3. Pattern matching is based on a set of templates that we 
specify, allowing us to identify people names, company 
names etc from a meeting text. 

4. In summary, with pattern matching, we no longer suffer 
from information overload. Of course, the big problem 
is how well our pattern matching works. If we rely 
exclusively on artificial intelligence processing, we do 
not have a 100% hit rate. We are able to identify about 
20% of all company names presented to us. 

Patterns 

A pattern in the context of a preferred embodiment is a 
template specifying the structure of a phrase we are looking 
for in a meeting text. The patterns supported by a preferred 
embodiment are selected because they are templates of 
phrases which have a high probability of appearing in 
someone's meeting text. For example, when entering a 
meeting in a calendar, many would write something such as 
"Meet with Bob Dutton from Stanford University next 
Tuesday." A common pattern would then be something like 
the word "with" followed by a person's name (in this 
example it is Bob Dutton) followed by the word "from" and 
ending with an organization's name (in this case, it is 
Stanford University). 

Pattern Matching Terminology 

The common terminology associated with pattern match- 
ing is provided below. 

Pattern: a pattern is a template specifying the structure of 
a phrase we want to bind the meeting text to. It contains 
sub units, pi Element: a pattern can contain many 
sub-units. These subunits are called elements. For 
example, in the pattern "with $ PEOPLES from 
$COMPANY$", "with" "$PEOPLE$" "from" 
"$COMPANY$" are all elements. 

Placeholder: a placeholder is a special kind of element in 
which we want to bind a value to. Using the above 
example, "$PEOPLE$" is a placeholder. 

Indicator: an indicator is another kind of element which 
we want to find in a meeting text but no value needs to 
bind to it. There may be often more than one indicator 
we are looking for in a certain pattern. That is why an 
indicator is not an "atomic" type. 

Substitute: substitutes are a set of indicators which are all 
synonyms of each other. Finding any one of them in the 
input is good. 

There are five fields which are identified for each meeting: 
Company ($COMPANY$) 
People (SPEOPLES) 
Location ($LOCATION$) 
Time (STTMES) 

Topic ($TOPIC_UPPERS) or (STOPIC_ALL$) 
In parentheses are the placeholders I used in my code as 
representation of the corresponding meeting fields. 
Each placeholder has the following meaning: 
SCOMPANYS: binds a string of capitalized words (e.g. 

Meet with Joe Carter of < Andersen Consulting>) 
$PEOPLE$: binds series of string of two capitalized 

words potentially connected by "," "and" or "&" (e.g. 

Meet with <Joe Carter> of Andersen Consulting, Meet 

with <Joe Carter and Luke Hughes> of Andersen 

Consulting) 

$LOCATTON$: binds a string of capitalized words (e.g. 
Meet Susan at <Palo Alto Square>) 
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$TIME$: binds a string containing the format #:## (e.g. 

Dinner at <6:30 pm>) 
$TOPIC_UPPER$: binds a string of capitalized words 

for our topic (e.g. <S tan ford Engineering Recruiting> 

Meeting to talk about new hires). 
$TOPIC_ALL$: binds a string of words without really 

caring if it's capitalized or not. (e.g. Meet to talk about 

<ubiquitous computing>) 
Here is a table representing all the patterns supported by BF. 
Each pattern belongs to a pattern group. All patterns within 
a pattern group share a similar format and they only differ 
from each other in terms of what indicators are used as 
substitutes. Note that the patterns which are grayed out are 
also commented in the code. BF has the capability to support 
these patterns but we decided that matching these patterns is 
not essential at this point. 
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PAT 
# 



PATTERN 



EXAMPLE 



$PEOPLE$ of 
SCOMPANYS 
SPEOPLES from 
$COMPANY$ 



Paul Maritz of Microsoft 



Bill Gates, Paul Allen and 
Paul Maritz from Microsoft 



a $TOPIC_UPPER$ meeting Push Technology Meeting 



$TOPIC__UPPER$ mtg 
c $TOPIC_UPPER$ demo 
d $TOPIC_UPPER$ 

interview 
e $TOPIC_UPPER$ 

presentation 
f $TOPIC_UPPER$ visit 
g $TOPIC_UPPER$ briefing 
h $TOPIC_UPPER$ 

discussion 
i $TOPIC_UPPER$ 

workshop 
j $TOPIC_UPPER$ prep 
k $TOPtC_UPPER$ review 
1 $TOPIC_UPPER$ lunch 
m $TOPIC_UPPERS project 
n $TOPIC_UPPER$ projects 
a SCOMPANYS corporation 
b SCOMPANYS corp. 
c SCOMPANYS systems 
d SCOMPANYS limited 
e SCOMPANYS ltd 
a about $TOPIC_ALL$ 

b discuss $TOP[C_ALL$ 

c show $TOPIC_ALL$ 



d re: $TOPlC_ALLS 



e review STOP I C_ ALLS 



f agenda 



g agenda: $TOPrC_ J ALL$ 



w/$PEOPLE$ of 
SCOMPANYS 
w/$PEOPLE$ from 
SCOMPANYS 
w/$COMPANY$ per 
SPEOPLES 
At STTMES 
Around STTMES 
At SLOCATTONS 



Push Technology Mtg 
Push Technology demo 
Push Technology interview 

Push Technology 

presentation 

Push Technology visit 

Push Technology briefing 

Push Technology 

discussion 

Push Technology 

workshop 

Push Technology prep 
Push Technology review 
Push Technology lunch 
Push Technology project 
Push Technology projects 
tntcl Corporation 
D3M Corp. 
Cisco Systems 
D3M limited 
D3M ltd 

About intelligent agents 
technology 

Discuss intelligent agents 

technology 

Show the client our 

intelligent agents 

technology 

re: intelligent agents 

technology 

Review intelligent agents 
technology 

The agenda is as follows: 

-clean up 

-clean up 

-clean up 

Agenda: 

-demo client intelligent 
agents technology, 
-demo ecommerce. 
Meet w/Joe Carter of 
Andersen Consulting 
Meet w/Joe Carter from 
Andersen Consulting 
Talk w/Intel per Jason 
Foster 
at 3:00 pm 
Around 3:00 pm 
At LuLu's resturant 
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PATTERN 


EXAMPLE 




b 


In SLOCATIONS 


in Santa Clara 


9 


a 


Per $PEOPLE$ 


per Susan Butler 


10 


a 


call w/$PEOPLE$ 


Conf call w/John Smith 




B 


call with $PEOPLE$ 


Conf call with John Smith 


11 


A 


prep for $TOPIC_^LL$ 


Prep for London meeting 




B 


preparation for 


Preparation for London 






STOPIC_ALL$ 


meeting 
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FIG. 4 is a detailed flowchart of pattern matching in 
accordance with a preferred embodiment Processing com- 
mences at function block 400 where the main program 
invokes the pattern matching application and passes control 
to function block 410 to commence the pattern match 
processing. Then, at function block 420, the wrapper func- 
tion loops through to process each pattern which includes 
determining if a part of the text string can be bound to a 
pattern as shown in function block 430. 

Then, at function block 440, various placeholders are 
bound to values if they exist, and in function block 441, a list 
of names separated by punctuation are bound, and at func- 
tion block 442 a full name is processed by finding two 
capitalized words as a fiill name and grabbing the next letter 
after a space after a word to determine if it is capitalized. 
Then, at function block 443, time is parsed out of the string 
in an appropriate manner and the next word after a blank 
space in function block 444. Then, at function block 445, the 
continuous phrases of capitalized words such as company, 
topic or location are bound and in function block 446, the 
next word after the blank is obtained for further processing 
in accordance with a preferred embodiment 

Following the match meeting field processing, function 
block 450 is utilized to loacte an indicator which is the head 
of a pattern, the next word after the blank is obtained as 
shown in function block 452 and the word is checked to 
determine if the word is an indicator as shown in function 
block 454. Then, at function block 460, the string is parsed 
to locate an indicator which is not at the end of the pattern 
and the next word after unnecessary white space such as that 
following a line feed or a carriage return is processed as 
shown in function block 462 and the word is analyzed to 
determine if it is an indicator as shown in function block 
464. Then, in function block 470, the temporary record is 
reset to the null set to prepare it for processing the next string 
and at function block 480, the meeting record is updated and 
at function block 482 a check is performed to determine if 
an entry is already made to the meeting record before 
parsing the meeting record again. 

Using the Identified Meeting Fields 

Now that we have identified fields within the meeting text 
which we consider important, there are quite a few things we 
can do with it. One of the most important applications of 
pattern matching is of course to improve the query we 
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construct which eventually gets submitted to Alta Vista and 
News Page. There are also a lot of other options and 
enhancements which exploit the results of pattern matching 
that we can add to BF. TTiese other options will be described 
in the next section. The goal of this section is to give the 
reader a good sense of how the results obtained from pattern 
matching can be used to help us obtain better search results. 

FIG. 5 is a flowchart of the detailed processing for 
preparing a query and obtaining information from the Inter- 
net in accordance with a preferred embodiment. Processing 
commences at function block 500 and immediately flows to 
function block 510 to process the wrapper functionality to 
prepare for an Internet search utilizing a web search engine. 
If the search is to utilize the Alta Vista search engine, then 
at function block 530, the system takes information from the 
meeting record and forms a query in function blocks 540 to 
560 for submittal to the search engine. If the search is to 
utilize the NewsPage search engine, then at function block 
520, the system takes information from the meeting record 
and forms a query in function blocks 521 to 528. 

Alta Vista Search Engine 

The strength of the Alta Vista search engine is that it 
provides enhanced flexibility. Using its advance query 
method, one can construct all sorts of Boolean queries and 
rank the search however you want. However, one of the 
biggest drawbacks with Alta Vista is that it is not very good 
at handling a large query and is likely to give back irrelevant 
results. If we can identify the topic and the company within 
a meeting text, we can form a pretty short but comprehen- 
sive query which will hopefully yield better results. We also 
want to focus on the topics found. It may not be of much 
merit to the user to find out info about a company especially 
if the user already knows the company well and has had 
numerous meetings with them. It's the topics they want to 
research on. 

News Page Search Engine 

The strength of the News Page search engine is that it 
does a great job searching for the most recent news if you are 
able to give it a valid company name. Therefore when we 
submit a query to the news page web site, we send whatever 
company name we can identify and only if we cannot find 
one do we use the topics found to form a query. If neither one 
is found, then no search is performed. The algorithm utilized 
to form the query to submit to Alta Vista is illustrated in FIG. 
7. The algorithm that we will use to form the query to submit 
to News Page is illustrated in FIG. 8. 

The following table describes in detail each function in 
accordance with a preferred embodiment. The order in 
which functions appear mimics the process flow as closely 
as possible. When there are situations in which a function is 
called several times, this function will be listed after the first 
function which calls it and its description is not duplicated 
after every subsequent function which calls it 
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Procedure 
Name 

Main 

(BF.Main) 



Type Called By Description 

Public None This is the main function 

Sub where the program first 

launches. It initializes BF 
with the appropriate 
parameters(e.g. Internet time- 
out, stoplisL..) and calls 
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Procedure 
Name 



Type 



Called By 



Description 



ProcessCom 
ma nd Line 
(BF.Main) 



CreateStopLi 
st 

(BF.Main) 



CreatePattern 
s 

(BF.Pattcra 
Match) 



Private Main 
Sub 



Private Main 
Function 



Public Main 
Sub 



GoBF 
(BF.Main) 



Public Main 
Sub 



GoBF to launch the main 
part of the program. 
This function parses the 
command line. It assumes 
that the delimiter indicating 
the beginning of input from 
Munin is stored in the 
constant 

CM D__SEPARXTOR 
This function sets ap a stop 
list for future use to parse out 
unwanted words from the 
meeting text. 

There ate commas on each 
side of each word to enable 
straight checking. 
This procedure is called once 
when BF is first initialized to 
create all the potential 
patterns that portions of the 
meeting text can bind to. A 
pattern can contain however 
many elements as needed. 
There are 

two types of elements. The 
first type of elements are 
indicators. These are real 
words which delimit the 
potential of a meeting field 
(eg company) to follow. 
Most of these indicators are 
stop words as expected 
because 

stop words are words 
usually common to all 
meeting text so it makes 
sense they form patterns. The 
second type of elements arc 
special strings which 
represent placeholders. 
A placeholder is always in 
the form of $*$ where * can 
be either PEOPLE, 
COMPANY, 
TOPIC_UPPER, 
TIME ? LOCATION or 
TOPIC __ALL. A pattern can 
begin with either one of the 
two types of elements and 
can be however long, 
involving however any 
numberAype of elements. 
This procedure dynamically 
creates a new pattern record 
for 

each pattern in the table and 
it also dynamically creates 
new tAPatteroElements for 
each element within a 
pattern. In addition, there is 
the concept of being able to 
substitute indicators within a 
pattern. For example, the 
pattern $PEOPLE$ of 
$COMFANY$ is similar to 
the pattern $PEOPLE$ from 
$COMPANY$. "from" is a 
substitute for "of. Our 
structure should be able to 
express such a need for 
substitution. 

This is a wrapper procedurer 
that calls both the parsing 
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Procedure 
Name 



Type Called By 



Description 



ParseMeeting 
Text 

(BF.Parsc) 



Public GoBackGroundF 
Function inder 



Forma tDelim 

itation 

(BF.Parsc) 



DetermineNu 

mWords 

(BF.Parsc) 



Parse MeetingTe 
xt, 

DetermineNum 
Words, 

GetAWordFrom 
String 



Public ParseMeeting 
Function Text, 

ProcessStop 

list 



GetAWordFr 

omstring 

(BF.Parse) 



Public ParseMeeting 
Function Text, 

ProcessStop 

list 



and the searching subroutines 
of the 

BF. It is also responsible for 
sending data back to Munin. 
This function takes the initial 
meeting text and identifies 
the userlD of the record as 
well as other parts of the 
meeting text including the 
title, body, participant list, 
location and time. In 
addition, we call a helper 
function ProcessStopList to 
eliminate all the unwanted 
words from the original 
meeting title and meeting 
body so that only keywords 
are left The information 
parsed out is stored in the 
MeetingRecord structure. 
Note that this function does 
no error checking and for the 
most time assumes that the 
meeting text string is 
correctly formatted by 
Munin. 

The important variable is 
thisMeeting Record is the 
temp holder for all info 
regarding current meeting. 
It's eventually returned to 
caller. 

There are 4 ways in which 
the delimiters can be placed. 
We take care of all these 
cases by reducing them 
down to Case 4 in which 
there are no delimiters 
around but only between 
fields in a string(e.g. 
A::B::C) 

This functions determines 
how many words there are in 
a string (stlnEvalString) The 
function assumes that each 
word is separated by a 
designated separator as 
specified in stSeparator. The 
return type is an integer that 
indicates bow many words 
have been found assuming 
each word 

in the string is separated by 
stSeparator. This function is 
always used along with 
GetAWordFromString and 
should be called before 
calling GetAWordFrom 
String. 

This function extracts the ith 
word of the 
string(stInEvalString) 
assuming that each word in 
the string is separated by a 
designated 

separator contained in the 
variable stSeparator. 
In most cases, use this 
function with 

DetermineNumWords. The 
function returns the wanted 
word. This function checks 
to make sure that 
ilnWordNum is within 
bounds so that i 
is not greater than the total 
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Procedure 
Name 



Type 



Called By 



Description 



Parse AndCIe 

anPfarase 

(BF.Parse) 



Private Parse MeeLingTe 

Function xt 



FindMLn 
(BF.Parse) 



Private 
Function 



ParseAndCleanP 
hrasc 



Clean Word 
(BRParse) 



Private 
Function 



ParseAndCleanP 
hrase 



Evaluate Wo r 
d 

(BF.Parse) 



Private 
Function 



ParseAndCleanP 
hrase 



number of words in string or 
less than/equal to zero, [f it 
is out of bounds, we return 
empty string to indicate we 
can't get anything. We try to 
make sure this doesn't 
happen by calling 
DetermineNumWords first 
This function first grabs the 
word and send it to 
Clean Word in order strip 
the stuff that nobody wants. 
There are things in 
parse Word that will kill 
the word, so we will need a 
method of looping through 
the body and rejecting 
words without killing the 
whole function 
i guess keep CleanWord and 
check a return value 
ok, now I have a word so I 
need to send it down the 
parse chain. This chain goes 
ParscCleanPhrase -> 
CleanWord -> 
Evaluate Word [f the woTd 
gets through the 
entire chain without being 
killed, U will be added at the 
end to our keyword string, 
first would be the function 
that checks for *T as a 
delimiter and extracts the 
parts of thaL This I will call 
"StitchFace" (Denise is more 
normal and calls it 
GetAWordFromString) 
if this finds words, then each 
of these will be sent, in turn, 
down the chain If 
these get through the entire 
chain without being added or 
killed then they will be 
added rather than tossed. 
This function takes in 6 input 
values and evaluates to see 
what the minimum non 
zero value is. ft first creates 
an array as a holder so that 
we can sort the five 
input values in ascending 
order. Thus the minimum 
value will be the first non 
zero value element of the 
array. If we go through 
entire array without finding 
a non zero value, we know 
that there is an error and we 
exit the function. 
This function tries to clean 
up a word in a meeting text. 
It first of all determines if the 
string is of a valid length. It 
then passes it through a 
series of tests to see it is 
clean and when needed, it 
will edit the word and strip 
unnecessary characters off of 
iL Such tests includes 
getting rid of file extensions, 
non chars, numbers etc. 
This function tests to see if 
this word is in the stop list so 
it can determine whether to 
eliminate the word from the 
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Procedure 
Name 



TVpe 



Called By 



Description 



GoPattcrnMa 
tch 

(BRPattera 
Match) 



MatchPattem 
s 

(BKPatlcrn 
Match) 



Public 
Sub 



GoBF 



Public 
Sub 



GoPaUera Match 



Private 
Function 



MatchPatterns 



(BRPattern 
Match) 



ctingField 

(BRPattera 

Match) 



Private 
Function 



MatchAPattcrn 



original meeting text, if a 
word is not in the stoplist, it 
should stay around as a 
keyword and this function 
exits beautifully with no 
errors. However, if the 
words is a stopword, an error 
must be returned. We must 
properly delimit the input 
test string so wc don't 
accidentally retrieve sub 
strings. 

This procedure is called 
when our QueryMethod is set 
to complex query meaning 
wc do want to do all the 
pattern matching stuff. It 's a 
simple wrapper function 
which initializes some arrays 
and then invokes pattern 
matching on the title and the 
body. 

This procedure loops through 
every pattern in the pattern 
table and tries to identify 
different fields within a 
meeting text specified by 
slnEvalString. For debugging 
purposes it also 
tries to tabulate how many 
times a certain pattern was 
triggered and stores it in 
gTabutateMatches to see 
whichp pattern fired the 
most. gTabulateMatchcs is 
stored as a global because we 
want to be able to ran a batch 
file of 40 or 50 test strings 
and still be able to know how 
often a pattern was triggered. 
This function goes through 
each element in the current 
pattern. It first evaluates to 
determine whether element is 
a placeholder or an indicator. 
If it is a placeholder, then it 
will try to bind the 
placeholder with some value. 
If it is an indicator, then we 
try to locate it There is a 
trick however. Depending on 
whether we are at current 
element is the head of the 
pattern or 

not we want to take 
different actions. If we are 
at the head, we want to 
look for the indicator or 
the placeholder. If we 
can't find it, then we 
know that the current 
pattern doesn't exist and 
we quit. However, if it is 
not the head, then we 
continue looking, because 
there may still be a head 
somewhere. We retry in 
this case. 

This function uses a big 
switch statement to first 
determine what kind of 
placeholder we arc talking 
about and depending on what 
type of placeholder, we have 
specific requirements 
and different binding criteria 
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Procedure 
Name 



Type 



Called By 



Description 



Bind Names 
(BF.Pattern 
Match) 



Private 
Function 



MatchMeetingFi 
eld 



BindAFullNa 
me 

(BKPattern 
Match) 



Private 
Function 



BindNames 



GetNextWor 

dAftcrWhite 

Space 

(BF.Pattern 

Match) 



BindTime 
(BF. Pattern 
Match) 



Private 
FUnction 



Private 
FUnction 



BindAFull 

Name, 

BindTime, 

BindCompanyTo 

picLoc 



MatchMeetingFi 
eld 



BindCompan 
yTbpicLoc 
(BF.Pattera 
Match) 



Private 
FUnction 



MatchMeetingFI 
eld 



as specified in the 
subsequent functions called 
such as BindNames, 
BindTime etc. If binding is 
successful we add it to our 
guessing record 
In this function, we try to 
match names to the 
corresponding placeholder 
$PEOPLE$. Names are 
denned as any consecutive 
two words which are 
capitalized. We also what to 
retrieve a series of names 
which are connected by and , 
or & so we look until we 
don't see any of these 3 
separators anymore. Note 
that we don't want to bind 
single word names because it 
is probably 

too general anyway so we 
don't want to produce broad 
but irrelevant results. This 
function calls 

BindAFUllName which binds 
one name so in a since 
BindNames collects all the 
results from BindAFullName 
This function tries to bind a 
full name. If the $PEOPLE$ 
placeholder is not the head of 
the pattern, we know that it 
has to come right at the 
beginning of the test string 
because we have been 
deleting stuff off the head of 
the string all along. 
If it is the head, we search 
until we find something that 
looks like a full name. If we 
can't find it, then there's no 
such pattern in the text 
entirely and we quit entirely 
from this pattern. This 
should eventually return us to 
the next pattern in 
MatchPattems. 
This function grabs the next 
word in a test string. It looks 
for the next word after white 
spaces, @ or /. The word is 
defined to end when we 
encounter another one of 
these white spaces or 
separators. 

Get the immediate next word 
and see if it looks like a time 
pattern. If so we've found a 
time and so we want to add it 
to the record. We probably 
should add more time 
patterns. But people don't 
seem to like to enter the time 
in their titles these days 
especially since we now have 
tools like Outlook. 
This function finds a 
continuous capitalized string 
and binds it to stMatch 
which is passed by reference 
from MatchMcetingFicld. A 
continuous capitalized string 
is a sequence of capitalized 
words which are not 
interrupted 
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Procedure 
Name 



Type 



Called By 



Description 



LocatePatter 
nHead 
(BEPattcrn 
Match) 



Private 
Function 



MatchAPattera 



Contain! nArr 
ay 

(BF.Pattem 
Match) 
Locatelndicat 
or 

(BRPattern 
Match) 



Private 
Function 



Private 
Function 



Locate Pattern 
Head, 

Locatelndicator 
MatchAPattern 



InitializeGue 
ssesRecord 
(BF.Pattem 
Match) 



AddToMeeti 
ngRecord 
(BRPattern 
Match) 



Private 
Sub 



Private 
Sub 



MatchAPattern 



MatchAPattern 



NoDupIicate 
Entry 

(BRPattern 
Match) 



SearchAltaVi 
sta 

(BRScarch) 



Private 
Function 



Public 
Function 



AddToMeetingR 
ecord 



GoBaci: Ground F 
inder 



by things like, . etc. There's 
probably more stuff we can 
add to the list of 
interruptions. 

This function tries to locate 
an element which is an 
indicator. Note that this 
indicator SHOULD BE AT 
THE HEAD of the pattern 
otherwise it would have gone 
to the function 
Locatelndicator instead. 
Therefore, we keep on 
grabbing the next word until 
either there's no word for us 
to grab (quit) or if we find 
one of the indicators we are 
looking for. 
'This function is really 
simple. It loops through all 
the elements in the array 
' to find a matching string. 
This function tries to locate 
an element which is an 
indicator. Note that this 
indicator is NOT at the head 
of the pattern otherwise it 
would have gone to 
LocatePatternHead instead. 
Because of this, if our 
pattern is to be satisfied, the 
next word we grab HAS to 
be the indicator or else we 
would have failed. Thus we 
only grab one word, test to 
see if it is a valid indicator 
and then return result. 
This function reinitializes 
our temporary test structure 
because we have already 
transfercd the info to the 
permanent structure, we can 
reinitialize it so they each 
have one clement 
This function is only called 
when we know that the 
information stored in 
tlnCurrGuesses is valid 
meaning that it represents 
legitimate guesses of 
meeting fields ready to be 
stored in the permanent 
recordjtlnMeetingRecord. 
We check to make sure that 
we do not store duplicates 
and we also what to clean up 
what we want to store so that 
there's no cluttered crap such 
as punctuations, etc. The 
reason why we don't clean up 
until now is to save time. We 
don't waste resources calling 
ParseAndCleanPhrase until 
we know for sure that we are 
going to add it permanently. 
This function loops through 
each element in the array to 
make sure that the test string 
aString is not the same as any 
of the strings already stored 
in the array. Slightly different 
from ContainlnArray. 
This function prepares a 
query to be submited to 
AltaVista Search engine. It 
submits it and then parses the 
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Procedure 
Name 



TVpe 



Called By 



Description 



CoastructAlt 

aVistaURL 

(BRSearch) 



Private 
Function 



SearchAlta Vista 



ConstructSi 

mpleKeyWor 

d 

(BRSearch) 



Private 
Function 



- ConstmctAlta Vi 
staURl, 

Const ructNewsP 
ageURL 



ConstructCo 
mplexAVKe 
yWord 
(BRSearch) 



Private 
Function 



ConstructAltaVi 
staURL 



JoinWithCon 

nectors 

(BRSearch) 



RefmeWithD 
ate (NOT 
CALLED AT 
THE 

MOMENT) 
(BRSearch) 

RefincWithR 
auk. 

(BRSearch) 



Private 
Function 



. Private 
Function 



Private 
Function 



ConstructCompl 

exAvKey 

Word, 

ConstructCompl 

exNPKey 

Word, 

RefineWith 

Rank 

ConstructAltaVi 
staURL 



ConstructAltaVi 
staURL 



returning result in the 
appropriate format 
containing the title, URL and 
body/summary of each story 
retrieved. The number of 
stories retrieved is specified 
by the constant 
NUM_AV_STORIES. 
Important variables include 
stURLAlta Vista used to store 
query to submit 
stResultHTML used to store 
html from page specified by 
stURLAlta Vista. 
This function constructs the 
URL string for the alta vista 
search engine using the 
advanced query search mode. 
It includes the keywords to 
be used, the language and 
how we want to rank the 
search. Depending on 
whether we want to use the 
results of our pattern 
matching unit, we construct 
our query differently. 
This function marches down 
the list of keywords stored in 
the sOldeKW or stBodyKW 
fields of the input meeting 
record and links them up into 
one string with each keyword 
separated by a connector as 
determined by the input 
variable stlnConnector. 
Returns this newly 
constructed string. 
This function constructs the 
keywords to be send to the 
AltaVista site. Unlike 
ConstructSimpleKeyWord 
which simply takes all the 
keywords from the title to 
form the query, this function 
will look at the results of BF 
*e pattern matching process 
and see if we arc able to 
identify any specific 
company names or topics for 
constructing 
the queries. Query will 
include company and topic 
identified and default to 
simple query if we cannot 
identify either company or 
topic. 

This function simply replaces 
the spacesbetween the words 
within the string with a 
connector which is specified 
by the input 



This function constructs the 
date portion of the alta vista 
query and returns this portion 
of the URL as a string. It 
makes sure that alta vista 
searches for articles within 
the past PAST_NDAYS. 
This function constructs the 
string needed to passed to 
Alta vista in order to rank an 
advanced query search. If we 
are constructing the simple 
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Procedure 
Name 



Type 



Called By 



Description 



IdentifyBloc 
k 

(BF.Parse) 



Public 
Function 



SearchAlta Vista, 
ScarchNcwsPagc 



IsOpenURLE 
nor 

(BF.Error) 



SearchNews 
Page 

(BRSearch) 



Public 
Function 



Public 
Function 



SearchAlta Vista, 
ScarchNcwsPagc 



GoBackGroundF 
inder 



ConstructNe 
wsPageURL 
(BKSearch) 



Private 
Function 



Search NewsPage 



ConstructCo 
mplcxNPKey 
Word 

(BRSearch) 



Private 
Function 



ConstructNcwsP 
ageURL 



ConstructOv 

erallResult 

(BF.Main) 



Private 
Function 



GoBackGroundF 
inder 



query we will take in all the 
keywords from the title. For 
the complex query, we wilt 
take in words from company 
and topic, much the same 
way we formed the query in 
ConstructCo mplcxAVKcyW 
ord. 

This function extracts the 
block within a string marked 
by the beginning and the 
ending tag given as inputs 
starting at a certain 
localion(iStart). The block 
retrieved does not include the 
tags themselves. If the block 
cannot be identified with the 
specified delimiters, we 
return unsuccessful through 
the parameter 

i Return Success passed to use 
by reference. The return type 
is the block retrieved. 
This function determines 
whether the error 
encountered is that of a 
timeout error. It restores the 
mouse to default arrow and 
then returns true if it is a time 
out or false otherwise. 
This function prepares a 
query to be submited to 
NewsPage Search 
engine. It submits it and then 
parses the returning result in 
the appropriate format 
containing the title, URL and 
body/summary of each story 
retrieved. The number of 
stories retrieved is specified 
by the constant 
UM_NP_STORIES 
This function constructs the 
URL to send to the 
NewsPage site. It uses the 
information contained in the 
input meeting record to 
determine what keywords to 
use. Also depending whether 
we want simple or complex 
query, we call diffent 
functions to form strings. 
This function constructs the 
keywords to be send to the 
NewsPage site. 
UnlikeConstructKeyWordStr 
ing which simply takes all 
the keywords from the title to 
form the query, this function 
will look at the results of BF 
's pattern matching process 
and see if we are able to 
identify any specific 
company names or topics for 
constructing 

the queries. Since newspage 
works best when we have a 
company name, we'll use 
only the company name and 
only if there is no company 
will we use topic. 
This function takes in as 
input an array of strings 
(stlnStories) and a 
MectingRccord which stores 
the information for the 
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Procedure 

Name Type Oiled By Description 



ConnectAnd 
TransferTo 
Munin 
(BF.Main) 



Public 
Sub 



GoBackGroundF 
inder 



DisconnectFr Public 
omMuninAn Sub 
d 

Quit 

(BF.Main) 



current meeting. Each 
element in the array stores 
the stories retrieved from 
each information source. 
The function simply 
constructs the appropriate 
output to send to Munin 
including a return message 
type to let Munin know that 
it is the BF responding and 
also the original user_id and 
meeting title so Munin 
knows which meeting BF is 
talking about 
This function allows 
Background Finder to 
connect to Munin and 
eventually transport 
information to Munin. We 
will be using the UDP 
protocol instead of the TCP 
protocol so we have to set up 
the remote host and port 
correctly. We use a global 
string to store gResult 
Overall because although it 
is unecessary with UDP, it is 
needed with TCP and if we 
ever switch back don't want 
to change code. 
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c FIG. 6 is a flowchart of the actual code utilized to prepare 
ind submit searches to the Alt a Vista and Newspage search 
engines in accordance with a preferred embodiment. Pro- 
cessing commences at function block 610 where a command 
line is utilized tojipdate^^cajend ar entry with spec ific 
calendar inf ormation. The messageis next posted in accoT 
dtoce~witri~runction block 620 and a meeting record is 
created to store the current meeting information in accor- 
dance with function block 630. Then, in function block 640 
the query is submitted to the Alta Vista search engine and in 
function block 650, the query is submitted to the Newspage 
search engine. When a message is returned from the search 
engine, it is stored in a results data structure as shown in 
function block 660 and the information is processed and 
stored in summary form in a file for use in preparation for 
the meeting as detailed in function block 670. 

FIG. 7 provides more detail on creating the query in 
accordance with a preferred embodiment. Processing com- 
mences at function block 710 where the meeting record is 
parsed to obtain potential companies, people, topics, loca- 
tion and a time. Then, in function block 720, at least one 
topic is identified and in function block 720, at least one 
company name is identified and finally in function block 
740, a decision is made on what material to transmit to the 
file for ultimate consumption by the user. 

FIG. 8 is a variation on the query theme presented in FIG. 
7. A meeting record is parsed in function block 800, a 
company is identified in function block 820, a topic is 
identified in function block 830 and finally in function block 
840 the topic and or the company is utilized in formulating 
the query 

Alternative embodiments for adding various specific fea- 
tures for specific user requirements are discussed below. 



Enhance Target Rate for Pattern Matching 

To increase BF's performance, more patterns/pattern 
^ groups are added to the procedure "CreatePatterns." The 
existing code for declaring patterns can be used as a template 
for future patterns. Because everything is stored as dynamic 
arrays, it is convenient to reuse code by cutting and pasting. 
The functions BindName, BindTime, BindCompanyLoc- 
45 Topic which are responsible for associating a value with a 
placeholder can be enhanced. The enhancement is realized 
by increasing the set of criteria for binding a certain meeting 
field in order to increase the number of binding values. For 
example, BindTime currently accepts and binds all values in 
the form of ##:## or #:##. To increase the times we can bind, 
we may want BindTime to also accept the numbers 1 to 12 
followed by the more aesthetic time terminology "o'clock." 
^Vocabulary based recognition algorithms and assigning an 
accuracy rate to each guess BF makes allowing only guesses 
55 which meet a certain threshold to be valid. 

Depending on what location the system identifies through 
pattern matching or alternatively depending on what loca- 
tion the user indicates as the meeting place, a system in 
accordance with a preferred embodiment suggests a plurality 

60 of fine restaurants whenever it detects the words lunch/ 
dinner/breakfast. We ca n also use a site like comgany_finder 
to confi rm what we^got is indeed a company na me or if .there 
is no compan y name that patternmatching c aril de o tify^we 
ca n use a company finder web site as a "dictionary^ for us 

65 to determine wh ether certain capitaliz ed words represen t, a 
co mpany name. „ We can even display stock prices and 
breaking news for a company that we have identified. 
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Wireless Bargain Identification in Accordance with a buyer-centric world. The services are intuitively organized 

a Preferred Embodiment around satisfying customer intentions - fundamental life 

n . „ • * j * * 4t- i» _j j needs or objectives that require extensive planning 

FIG. 9 is a flow diaeram that depicts the hardware and , . . ■ J 4 . n , • f 

\ lvJ *' lja " v , . j - t decisions, and coordination across several dimensions, such 

logical flow of control for a device and a software system „ . * . . , . . . , ^rv • , 

, & . „ . j ... 5 as financial planning, healthcare, personal and professional 

designed to allow Web-based comparison shopping in , f r -t Vr j *i_ c i u^, 

. . . . . „, . . JL 4 A development, family life, and other concerns. Each member 

conventional, physical, non-Web retail environments. A j • * • u- ci uv h* m *,*~»«t» 

. , i ... - i j * n^n owns and maintains his own profile, enabling him to create 

wireless phone or similar hand-held wireless device 92U . . , , " -i- n„ Bi 

. , , r „ , . • « . j . . and browse content m the system targeted specifically at 

with Internet Protocol capability is combined with a mini a- . 4 . -\ . *V ' ^ • ' • 

, , j n i n / ii j -.u * *u u him. From the time a demand for products or services is 

hire barcode reader 910 (installed either inside the phone or ^ n , «p™ f ™f* • „ f ,^ rttc m 

. _ , t x j j ti • , n . 4 10 entered, to the completion or payment, intelligent agents are 

on a short cable) and used to scan the Universal Product ... ' , /V M . ^ 

^ j n i j , , . . , 4 nfkn ™ utilized to conduct research, execute transactions and pro- 
Code (UPC) bar code on a book or other product 900. The . , , . _ . - ' , , - u . \. 
i j • n ™ . v j t vide advice. By using advanced profiling and filtering, the 

wireless device 920 transmits the bar code via an antennae . „. t \ i * ,u~\.^, % *ul 

930 to the Pocket BaigainFinder Service Module (running mttU, 8f <» lear ° 'he u«r improving the ^r- 

^ ^ <xa* i_ ■ * ^ •* . /• .u * vices they deliver. Customer intentions demonstrated 

on a Web ^rver) 940 wtach converts ,t to (m the case of ' ( cnwil^calendar, 

books) .ts lnternauona Standard Book Number or (in the C9sm ^_^^ : ^ =s ^^ pp ^r^l 

case of o her products) whatever identmer « appropriate. ^—^~ mi Movi to ^ w Cbm mMlfeiTESdlng 

The Service Module men contact the appropriate third- %^^ mo ^ ho ^ oXAv ^ { ^X^ travel 

party Web site(s) to find price, shipping and availability , - A f . * . , 

" c y 4 . V , ^1 - wu r oeii and shipping insurance coverage, notifying business and 

information on the product from various Web suppliers 950. f r f A . , * / ° - . ^ 

=rr . " " 4 . , , , y \, . , 20 personal contacts, learning about the new commumty). From 

This information is formatted and displayed on the hand- ^ _ • , „ irC ; ta! • „ ^ n , rn i iL i;An 

, .... . „ Tn . . , , t ■% a consumer standpomt, mySite! provides a central location 

l eV1Ce «^ re f r ^ r 5 or ° ther _ hand where a user can access relevant products and services and 

held dev,ce 920 utilizes a wueless modem such as a Rico- a lisb dail tasks ^ ulti J te ease ^ co^ience. 

chet SE Wireless Modem from Metricom. Utilizing this „ i_ • » j_ ■ * o**i * 1 
j . , . _ « . #u * . . From a business standpomt, mySite! represents a value- 
device, a user can hang out in a coffee shop with a portable , , , , . . ' & \- , * t • A 
\ . j 5 . . ^ v##1 , %u *^ , _ 25 added and innovative way to effectively attract, service, and 
computer perched on a rickety little table, with a latte . J 7 
! if - j i i * *i_ 1 u j j * u retam customers, 
sloshmg dangerously close to the keyboard, and access the 

Internet at speeds rivaling direct connect via a telephone Egocentric Interface 

^ ne_ An Egocentric Interface is a user interface crafted to 

The 8-ounce Ricochet SE Wireless Modem is about as 3Q S2LX ^fy a particular user's needs, preferences and current 
large as a pack of cigarettes and setup is extremely simple, context. It utilizes the user's personal information that is 
simply attach the modem to the back of your portable's stored in a central profile database to customize the inter- 
screen with the included piece of Velcro, plug the cable into face can ^ security permissions on and prefer- 
the serial port, flip up the stubby antenna, and transmit. eaces for i nte rface elements and content. The content inte- 
Sofrware setup is equally easy: a straightforward installer 35 grate( | mto tne Egocentric Interface is customized with 
adds the Ricochet modem drivers and places the connection related information about the user. When displaying content, 
icon on your desktop. The functional aspects of the modem the Egocentric Interface will include the relationship 
are identical to that of a traditional telephone modem. between that content and the user in a way that demonstrates 

Of course, wireless performance isn't nearly as reliable as how the content relates to the user. For instance, when 

a traditional dial-up phone connection. We were able to get 40 displaying information about an upcoming ski trip the user 

strong connections in several San Francisco locations as has signed up for, the interface will include information 

long as we stayed near the windows. But inside CNET's about events from the user's personal calendar and contact 

all-brick headquarters, the Ricochet couldn't connect at all. hst, such as other people who will be in the area during the 

When you do get online, performance of up to 28.8 kbps is s ki trip. This serves to put the new piece of information into 

available with graceful degradation to slower speeds. But 45 a context familiar to the individual user, 

even the slower speeds diaVt disappoint. Compared to the pjQ job is a flowchart providing the logic utilized to 

alternative— connecting via a cellular modem— the Rico- |*S create a web page within the Egocentric Interface. The 

chet is much faster, more reliable, and less expensive to use. environment assumes a web server and a web browse r 

Naturally, the SE Wireless is battery powered. The modem connected mrou gha TCMP netwo rk^such as-over tne 

has continuous battery life of up to 12 hours. And in 50 pyjEE TInternet or a private Intranet. Hossime~weB^scrvers 

accordance with a preferred embodiment, we ran down our coulH in clude Microsoft In tern eTlnformTtion Server, 

portable computer's dual cells before the Ricochet started to NetsHpelEnterpriseSe ryer or A pache.^ssible3Ke.bJ?rows- 

fade. erslnclude Microsoft Internet. Explorer or Nej scape.Navk 

Thus, utilizing the wireless modem, a user may utilize the gator: The client (L er^r75row ser).m akes a reg ues OPOl to 

web server software 940 to identify the right product 950 55 the server (i'eTweb server) for a particular web page. This is 

and then use an appropriate device's key(s) to select a usually accomplished by a user clicking on a button or a link 

supplier and place an order in accordance with a preferred within a web page. The web server gets the layout and 

embodiment. The BargainFinder Service Module then con- content preferences 1002 for that particular user, with the 

summates the order with the appropriate third-party Web request to the database keyed off of a unique user id stored 

supplier 960. 60 in the client (i.e. web browser) and the User profile database 

1003. The web server then retrieves the cont ent 1004 fo r the 

mySite! Personal Web Site & Intention Value pagethaTTSs- been re^^TbSSnSS^^T^^^ 

Network Prototype 1(M)5. 'Ine relevant iSeVcentric content, such as calendar, 

mySite! is a high-impact, Internet-based application in email, contact fist, and task list items are then retrieved 

accordance with a preferred embodiment that is focused od 65 1006. (See FIG. 11 for a more detailed description of this 

the theme of delivering services and providing a personal- process.) The query to the database utilizes the user content 

ized experience for each customer via a personal web site in preferences stored as part of the user profile in the User 
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FIG. 13 describes the data model that supports the Per- 
sona concept. The user table 1310 contains a record for each 
user who has an account in the system. This table contains 
a username and a password 1320 as well as a unique 
identifier. Each user can have multiple Personas 1330, which 
act as containers for more specialized structures called 
Profiles 1340. Profiles contain the detailed personal infor- 
mation in Profile Field 1350 records. Attached to each 
Profile are sets of Profile Restriction 1360 records. These 
each contain a Name 1370 and a Rule 1380, which define the 
restriction. The Rule is in the form of a pattern like (if x then 
y), which allows the Rule to be restricted to certain uses. An 
example Profile Restriction would be the rule that dictates 
that the user cannot book a flight on a certain airline 
contained in the list. This Profile Restriction could be 
15 contained in the "Travel" Profile of the "Work" Persona set 
up by the user's employer, for instance. Each Profile Field 
also contains a set of Permissions 1390 that are contained in 
that record. These permissions dictate who has what access 
rights to that particular Profile Field's information. 

Intention-Centric Interface 

Satisfying Customer Intentions, such as Planning for 
Retirement or Relocating requires a specialized interface. 
Customer Intentions require extensive planning and coordi- 
nation across many areas, ranging from financial security, 
housing and transportation to healthcare, personal and pro- 
fessional development, and entertainment, among others. 
Satisfying Intentions requires a network of complementary 
businesses, working across industries, to help meet consum- 
ers* needs. 

An Intention-Centric Interface is a user interface designed 
to help the user manage personal Intentions. At any given 
point, the interface content is customized to show only 
content that relates to that particular Intention. The 
Intention-Centric Interface allows the user to manage the 



profile database 1003 to filter the content that is returned. 
Hie content that is returned is then formatted into a web 
page 1007 according to the layout preferences defined in the 
user profile. The web page is then returned to the client and 
displayed to the user 1008. 5 

FIG. 11 describes the process of retrieving user-centric* 
content to add to a web page. This process describes 1006 in 
FIG. 10B in a more detailed fashion. It assumes that the 
server already has obtained the user profile and the existing 
content that is going to be integrated into this page. The 
server parses 1110 the filtered content, looking for i nstances 
of e vents, contact names a nd email addres ses. If a ny of these 
ate"found, they are tagged and stored in a temporary holding 
space. Then, the server tries to find any user-centric content 
1120 stored in various databases. This involves matching the 
tagged items in the temporary storage space with calendar 
i tems 1130 in the Calendar DatabascJ140: email.ite niSiSB 
in the Email Hatahase^ 111,4; c ontact items 1117 in the 
C&irtagfc gatap'aseTI^ 

DaTab"aselll8 : and news items 1121 in the News D atabase 
1120. After retrieving any relevant user-centric content, it is 
compiled together and returned 1122. ^ 

User Persona 

The system allows the user to create a number of different 
personas that aggregate profile information into sets that are 25 
useful in different contexts. A user may create one persona 
when making purchases for his home. This persona may 
contain his home address and may indicate that this user is 
looking to find a gpod bargain when shopping. The same 
user may create a second persona that can be used when he 30 
is in a work context. This persona may store the user's work 
address and may indicate that the user prefers certain ven- 
dors or works for a certain company that has a discount 
program in place. When shopping for work-related items, 

the user may use this persona. A persona may also contain 35 process of satisfying that particular Intention. This involves 
rules and restrictions. For instance, the work persona may a series of discrete steps and a set of content areas the user 
restrict the user to making airline reservations with only one can access. At any point, the user can also switch the 
travel agent and utilizing booking rules set up by his interface to manage a different Intention, and this act will 
employer. change the content of the interface to include only that 

FIG. 12 describes the relationship between a user, his 40 content which is relevant to the satisfaction of the newly 
multiple personas and his multiple profiles. At the User selected Intention. 

Level is the User Profile 1200. This profile describes the user .0 FIG. 14 provides a detailed description of the data model 
and his account information. There is one unique record in ^needed to support an Intention-Centric Interface. Each User 
the database for each user who has an account. Attached to 1410 (see FIG. 13 for a mo^d^i^ammoi 

each user are multiple Personas 1220, 1230 & 1240. These 45 ^ PersonaJaUm^del.) has any number of active User 
Personas are used to group multiple Profiles into useful 
contexts. For instance, consider a user who lives in San 
Francisco and works in Palo Alto, but has a mountain cabin 
in Lake Tahoe. He has three different contexts in which he 



r 



Intentions 1420. Each active User Intention is given a 
Nickname 1430, which is the display name the user sees on 
the screen. Each active User Intention also contains a 
number of Data Fields 144(^jyjuch contain any user da ta 
collected throughout "the interaction with the user. For 



might be accessing his ^site. One context is ; work-related. The so instanterifthe-user-had-fillea out a tbrm onlhTscreeh and 

one of the fields was Social Se curit y Number, the^corre- 
sponoing~ Pata"FieId woulQ ^onta jfTNSne ="$'SN M ' 1450 , 
Value="999"^9-9999" 146fiTBach U ser Intention alsokeeps 
track of Intention Step 1470 completion status. The Comple- 
55 tion 1480 field indicates whether the user has completed the 
step. Every User Intention is a user-specific version of a 
Generic Intention 1490, which is the default model for that 
Intention for all users. The Generic Intention is customized 



other two are home-life related, but in different locations 
The user can create a Persona for Work 1220, a Persona for 
Home 1230, and a Persona for his cabin home 1240. Each 
Persona references a different General Profile 1250, 1260 
and 1270 which contains the address for that location. 
Hence, there are three General Profiles. Each Persona also 
references one of two Travel Profiles. The user maintains a 
Work Travel Profile 1280 that contains all of the business 

rules related to booking tickets and making reservations. through Custom Rules 1411 and 1412 that are attached to the 
This Profile may specify, for instance, that this person only 60 S ub-steps in the Intention. These Custom Rules are patterns 



travels in Business or First Class and his preferred airline is 
United Airlines. The Work Persona references this Work 
Travel Profile. The user may also maintain a Home Travel 
Profile 1290 that specifies that he prefers to travel in coach 
and wants to find non-refundable fairs, since they are 
generally cheaper. Both the Persona for Home and the 
Persona for the cabin home point to the Home Travel Profile. 



65 



describing how the system will customize the Intention for 
each individual user using the individual user's profile 
information. 

Statistical Agent 
An agent keeps track of key statistics for each user. These 
statistics are used in a manner similar to the Tamagochi 



4 
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virtual reality pet toy to encourage certain behaviors from 
the user. The statistics that are recorded are frequency of* 1 
login, frequency of ra ting of conten t such as news ar ticles^ 1 
and "activity of agentsTTneasured by the number ot tasks 
which it^perfbrms lTTa c ertain period. This information is J5 
used by the system to emotionally appeal to the user to 
encourage certain behaviors. 

FIG. 15 describes the process for generating the page that 
displays the agent's current statistics. When_jhe__user 



requests the agent statistics page 1510 with the clien t 



browsert he server re tri eves the users' st atistics-1520Lfrom 



10 



)rowser._t he server r etgj _ 

the usels^profile -databas e. 1530. The server then perform s 
the majhe matical calculations necessary to create a norm a l - 
ized set o f statistics 1540. The server t hen rejrjejff^ the 
f onnulas"f550 from the coj iienLdata hase lSfij Lthat-WdU be 
used to calcula te the user-centri c statistics. Gra phs are then 
genefated T570 using tne generic tormuJas and tnat user's 
statistics. These graphs are inserted into a template to create 
the statistics page 1580. This page is then returned to the 
user 1590. J 

Personalized Product Report Service 

The system provide Consumer Report-like service that is 
customized for each user based on a user profile. The system 
records and provides ratings from users about product 
quality and desirability on a number of dimensions. The 
difference between this system and traditional product qual- 
ity measurement services is that the ratings that come back 
to the users are personalized. This service works by finding 
the people who have the closest match to the user's profile 
and have previously rated the product being asked for. Using 
this algorithm will help to ensure that the product reports 
sent back to the user only contain statistics from people who 
are similar to that user. 

FIG. 16 describes the algorithm for determining the 
personalized product ratings for a user. W hen tbe use r 
requests a product report 1 6 ^0 fpr product X, the M algpnthm 
retrieves the profiles 1620 from the profile database 1630 



(which inc ludes product ratings) of those users who have 40 
pr eVKjusiy rated tnat proauct. 1 penJ oe_sYsle m [gri eves the 
default thresholds 164^ for the profile matching algorithm 
from the content database 16507lTihen maps all of ihe short 
list of users along several dlmensiori s-specified in the_profil e 
matching algorit hm 1660 . The top n (specified pj^yjously.as 45 
a mreslrolo^variab le) nearest neighbors are then determined 
and a test is performed to decide if they are within distance 
y (als o specified previously _^_a_truxshQld_variable > ) of the 
user's profile in the set 1670 using the results from the 
profile matching algorithm. If they are not within the 50 
threshold, then the threshold variables are relaxed 1680, and 
the test is run again. This processing is repeated until the test 
returns true. The product ratings from the smaller set of n 
nearest neighbors are then used to determine a number of 
product statistics 1690 along several dimensions. Those 
statistics are inserted into a product report template 1695 and 
returned to the user 1697 as a product report. 



user. A Personal Digital Assistant (PDA) with Internet 
access can synchronize the person's calendar, em ail, contac t 
list, task list and notes on the PDA with the version stored 
in the Internet site. This enables the person to only have to 
maintain one version of this data in order to have it available 
whenever it is needed and in whatever formats it is needed. 

FIG. 17 presents the detailed logic associated with the 
many different methods for accessing this centrally stored 
profile. TTie profile database 1710 is the central stora ge place 
fo r the users' profile. information. T h e profile gateway server 
1 Tgftj^fgiyf^ all requests for profi le information, whether 
from the user himself or merchants trying to provide a 
ser vice to the u ser. The^rgjjk gateway server is responsible 
l or^ensunng tnarinfoTmaubh^is oniy given out when the 
profile" owner specifically grants permission. A ny device that 
can access the public Internet 1730 over TCP/IP (a standard 
network communications protocol) is able to request infor- 
mation from the profile ^at abase via intelligent HTTP 
requests. Consumers will be able to gain access to services 
from devices such as t heir televisions 1740. mobile phones, 
Smart Ca rds, gas meters, water meters, kitchen appliances, 
security Systems, desktop computer s, laptops, pocket 
o rganizers, PU i^._anxLihdii^hi cles« among others . 
Likewise, merchants 1750 will be able to access those 
profiles (given permission from the consumer who owns 
each profile), and will be able to offer customized, person- 
alized services to consumers because of this. 
^ne possible use of the ubiquitous profile is for a hotel 
* chain. A consumer can carry a Smart Card that holds a digital 
certificate uniquely identifying him. This Smart Card's^ 
digital certificate has been issued by the system and it 
recorded his profile information into the profile database. 
The consumer brings this card into a hotel chain and checks 
in. The hotel employee swipes the Smart Card and the 
consumer enters his Pin number, unlocking the digital 
certificate. The certificate is se nt to the, profile gatewa y 
server (using ale^ure~ff gs5aission protocol) and i s aut hen- 
ti'catedZthc Jiotei is then jivej£ac^essiQ^^rtain.p art oftKjT 
cons umer's j ?rofil e tha t he has_previously specified. The 
hoteLca n then retriev e all of the consu mexlslbillin g infor - 
mation as w^L^as prefere nces tor boteTroom, etc. Ttjehotel 
can aj§o_ access tne consumer l s movie and P dining, prefer - 
en ces a nd offer customized menus for both otTnemTThe 
hotel can offer to send an email to the consumer's spouse 
letting him/her know the person checked into the hotel and 
is safe. All transaction information can be uploaded to the 
consumer's profile after the hotel checks him in. This will 
allow partners of the hotel to utilize the information about 
the consumer that the hotel has gathered (again, given the 
consumer's permission). 
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Intention Value Network 



55 



Personal Profile and Services Ubiquity 

This system provides one ce ntral storage place fo r a 
persor£sprofile. This storage place is a server available" 
through trie public Internet, accessible by any device that is 
connected to the Internet and has appropriate access. 
Because of the ubiquitous accessibility of the profile, numer- 
ous access devices can be used to customize services for the 
user based on his profile. For example, a merchant's web site 
can use this profile to provide personalized content to the 



In an Intention Value Network, the overall integrator 
system coordinates the delivery of products and services for 
a user. The integrator manages a network of approved 
suppliers providing products and services, both physical and 
virtual, to a user based on the user's preferences as reflected 
in the user's profile. The integrator manages the relationship 
60 between suppliers and consumers and coordinates the sup- 
pliers' fulfillment of consumers' intentions. It does this by 
providing the consumer with information about products and 
suppliers and offering objective advice, among other things. 
1*7 3 FIG. 18 discloses the detailed interaction between a 
65 consumer and the integrator involving one supplier The user 
accesses a Web Browser 1810 and requests product and 
pricing information from the integrator. The request is sent 
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from the user's browser to the integrator's Web/Application 
Server 1820. The user's preferences and personal informa- 
tion is obtained from an integrator's customer profile data- 
base 1830 and returned to the Web/Application server. The 
requested product information is extracted from the suppli- 
er's product database 1840 and customized for the particular 
customer. The Web/Application server upd ates the suppli 



er's customer information database 18&Twith the inquiry 
i nformation abo ut tne customer, ine product - an d~prfeing 
"information is then formatted~tnto a Web Page 1860 and 
returned to the customer's Web Browser. 



15 



20 



Summary Agent 

A suite of software agents running on the application and 
web servers are programmed to take care of repetitive or 
mundane tasks for the user. The agents work according to 
rules set up by the user and are only allowed to perform tasks 
explicitly defined by the user. The agents can take care of 
paying bills for the user, filtering content and emails, and 
providing a summary view of tasks and agent activity. The 
user interface for the agent can be modified to suit the 
particular user. 

FIG. 19 discloses the logic in accordance with a preferred 
embodiment processing by an agent to generate a verbal 
summary for the user. When the user requests the summary 
page 1900, the server gets the user's agent preferences 1920, 
such as agent type, rules and summary level from the user 
profile database 1930. The server gets the content 1940, such 
as emails, to do list items, news, and bills, from the content 
database 1950. The agent parses all of this content, using the 
rules stored in the profile database, and summarizes the 
content 1960. The content is formatted into a web page 1970 
according to a template. The text for the agent's speech is 
generated 1980, using the content from the content database 
1990 and speech templates stored in the database. This 
speech text is inserted into the web page 1995 and the page 
is returned to the user 1997. 

Trusted Third Party 

40 

The above scenario requires the web site to maintain a 
guarantee of privacy of information according to a published 
policy. This system is the consumer's Trusted Third Party, 
acting on his behalf in every case, erring on the side of 
privacy of information, rather than on the side of stimulation 45 
of commerce opportunities. The Trusted Third Party has a 
set of processes in place that guarantee certain complicity 
with the stated policy. 

"meCommerce" 

50 

This word extends the word "eCommerce" to mean 
"personalized electronic commerce." FIG. 20 illustrates a 
display login in accordance with a preferred embodiment. 
The display is implemented as a Microsoft Internet Explorer 
application with an agent 2000 that guides a user through the 55 
process of interacting with the system to customize and 
personalize various system components to gather informa- 
tion and interact with the user's personal requirements. A 
user enters a username at 2010 and a password at 2020 and 
selects a button 2040 to initiate the login procedure. As the 60 
logo 2030 suggests, the system transforms electronic com- 
merce into a personalized, so called "me" commerce. 

FIG. 21 illustrates a managing daily logistics display io^ 
accordance with a preferred embodiment. A user is greeted 



fi nances 2} 30 and misplace activities 2140. Icons 2142 
f or roulingjpks^ffh^ r^ rnail, calendaring and docum ent 
prq55raTtoTTare also prfcviclecf to fac ilitate rapid navi gation 
fj onTT5TFal3ivIty to anomerrPTre^ninfo 2"|46 are, akn 
5 p rovided to allow transfer of news and other item sof 
interest Various profiles can be selected based on where the 
user is located. For example, work, home or vacation. The 
profiles can be added 2170 as a user requires a newj) rojile 
for another locatio n. Various items 2irf0 of personal infor- 
10 mation are collected from the user to support v arious 
endeavors. Moreover, permissions 2150 are set for items 
2180 to assure information is timely and current. 

FIG. 22 illustrates a user main display in accordance with 
a preferred embodiment. World 2200 and local news 2210 is 
provided based on a user's preference. The user has also 
selected real estate 2230 as an item to provide direct 
information on the main display. Also, a different agent 2220 
is provided based on the user's preference. 

FIG. 23 illustrates an agent interaction in accordance with 
a preferred embodiment. The agent 2310 is communicating 
information 2300 to a user indicating that the user's life 
insurance needs have changed and pointing the user to the 
chart that best summarizes the information for the user. 
Particular tips 2395 are provided to facilitate more detailed 
information based on current user statistics. A chart 2370 of 
the user's life insurance needs is also highlighted at the 
center of the display to assist the user in determining 
appropriate action. A button 2380 is provided to facilitate 
changing the policy and a set of buttons 2390 are provided 
1 to assist a user in selecting various views of the user's 
insurance requirements. 

Event Backgrounder 

; ^ ^n Event Backgrounder is a short description of an 
upcoming event that is sent to the just before an event. The 
Event Back-rounder is const antly upd ated with the latest 
information related to this event. Pertinent information sued 
as itinerary aBd~togi stic s are -included, and other useful 
1 information, such as people the user knows who might be in 
the same location, are also included. The purpose of the 
Event Back- rounder is to provide the most up-to-date infor- 
mation about an event, drawing from a number of resources, 
such as public web sites and the user's calendar and contact 
lists, to allow the user to react optimally in a given situation. 

Vicinity Friend Finder 

This software looks for opportunities to tell the user when 
a friend, family member or acquaintance is or is going to be 
in the same vicinity as the user. This software scans the 
user's calendar for upcoming events. It then uses a geo- 
graphic map to compare those calendar events with the 
calendar events of people who are listed in his contact list. 
It then informs the user of any matches, thus telling the user 
that someone is scheduled to be near him at a particular time. 

Information Overload 

The term information overload is now relatively under- 
stood in both its definition as well as its implications and 
consequences. People have a finite amount of attention that 
is available at any one time, but there is more and more 
vying for that attention every day. In short, too much 
information and too little time are the primary factors 



2190. The user can select from vari ous ac tivities ba sed on 
requirements, including travel 2110, household chores 2120, 



by_ a n animat ed a^nt ^ 2100 with a personalized message >5 complicating the lives of most knowledge workers today. 



The first attempts to dynamically deal with information 
overload were primarily focused on the intelligent filtering 
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of information such that the quantity of information would 
be lessened. Rather than simply removing random bits of 
information, however, most of these approaches tried to be 
intelligent about what information was ultimately presented 
to the user This was accomplished by evaluating each 5 
document based on the user's interests and discarding the 
less relevant ones. It follows, therefore, that the quality was 
also increased. 

Filtering the information is only a first step in dealing with 
information is this new age. Arguably, just as important as 10 
the quality of the document is having ready access to it. 
Once you have entered a meeting, a document containing 
critical information about the meeting subject delivered to 
your office is of little value. As the speed of business 
continues to increase fueled by the technologies of 15 
interconnectedness, the ability to receive quality information 
wherever and whenever you are becomes critical. This new 
approach is called intelligent information delivery and is 
heralding in a new information age. 

20 

A preferred embodiment demonstrates the intelligent 
information delivery theory described above in an attempt to 
not only reduce information overload, but to deliver high 
quality information where and when users* require it. In 
other words, the system delivers right information to the 
right person at the right time and the right place. 25 
Active Knowledge Management System Description 

FIG. 24 is a block diagram of an active knowledge 
management system in accordance with a preferred embodi- 
ment. The system consists of the following parts: back-end ^ 
2400 connection to one or more servers, personal mobile 
wireless clients (Awareness Machine)2430, 2436, public 
clients (Magic Wall) 2410, 2420, web clients 2446, 2448, 
e-mail clients 2450, 2460. 
Back-end Server (2400) Processes 

FIG. 25 is a block diagram of a back end server in 35 
accordance with a preferred embodiment. The back-end 
(2400 of FIG. 24) is a computer system that has the 
following software active: Intelligent Agents Coordinator 
(Munin) 2580, Information Prioritization Subsystem 2530, a 
set of continuously and periodically running information 
gathering and processing Intelligent Agents 2500, 2502 and 
2504, User Profiles Database 2542 and supporting software, 
Information Channels Database 2542 and supporting 
software, communications software 2550, information trans- 
formation software 2560, and auxiliary software. 45 
The Awareness Machine (2446 & 2448 of FIG. 24) 

The Awareness Machine is a combination of hardware 
device and software application. The hardware consists of 
handheld personal computer and wireless communications 
device. TTie Awareness Machine reflects a constantly 
updated state-of-the-owner's-world by continually receiving 
a wireless trickle of information. This information, mined 
and processed by a suite of intelligent agents, consists of 
mail messages, news that meets each user's preferences, 
schedule updates, background information on upcoming 55 
meetings and events, as well as weather and traffic. 

FIG. 26 is a block diagram of a magic wall in accordance 
with a preferred embodiment. 
The Magic Wall 

The Magic Wall hardware includes: 0 

Computer system 2640 connected to the back-end server 

Sensor array 2634, 2630 and 2632 detects presence, 
position, and identity of a person 

Large touch-sensitive display 2620 55 

Sound input 2610 /output 2614 hardware 

The Magic Wall software supports: 
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Multimedia output compatible with current Web stan- 
dards 
Speech recognition 
Tactile input 

Intelligent agents representations in the form of speech- s 

enabled animated characters 
The Magic Wall operates as follows: 

1. If a user appears in the vicinity of Magic Wall, the 
sensor array triggers "user here" event that sends an 
environmental cue containing the person's id and the 
location to the Intelligent Agent Coordinator. 

2. User is identified based on the information returned by 
the sensor array. 

3. The Magic Wall switches to "locked on the user" mode. 
If another user approaches, the system will notify him 
or her that it cannot serve another user while the current 
user is being served. 

4. Intelligent Agent Coordinator is notified about the user 
presence. 

5. The Intelligent Agent Coordinator decides if there is 
pertinent information that the user would be interested 
in and Magic Wall location time-sensitive information 
to show (e.g. tr affic report, meeting reminde r). If such 
information exists, it is prepared for delivery. If not, 
control is transferred to the Information Prioritization 
Subsystem. 

6. Information Prioritization Subsystem decides what 
information is most relevant to the user based on their 
personal profile, freshness of the information, and the 
Intelligent Agent Coordinator's prior suggestions. 

7. The page of information identified as the most relevant 
to the user at this time and place is shown. The act of 
the information delivery can also include animation and 
speech output of the intelligent agent representation. 

8. If a user desires, he or she can ask Magic Wall to show 
a particular page. The Magic Wall recognizes the 
speech fragment and then identifies and shows the 
requested page. 

9. As the user departs from the Magic Wall area, the 
sensor array triggers "user left" event. 

10. The Magic Wall switches back to the waiting state. 
Other Clients 

The Web client is a standard browser navigating to a set 
of Web pages which allow user to see the same information 
that is available via the Magic Wall. 

The e-mail client is any standard e-mail program. 
Intelligent Agent Coordinator Description 

This piece of code is the coordinating agent (or meta- 
agent) for the Active Knowledge Management system. This 
means that all communications between the system and each 
user, as well as communication between the different minion 
agents are handled (coordinated) by the Intelligent Agent 
Coordinator. Examples of these minion agents are: 

BackgroundFinder — an agent that parses meeting text 
determining important keywords and phrases and finds 
background information on the meeting for each user 
TrafficFinder — an agent that finds traffic information for 

each user based on where they live 
Sev eral other age nts that are responsible for do ing statis- 
Ucal analvsis" ^ ~ the data m each iis>c rV^fo fiie ancl 
u pHating fieldspertinent to tnai data " 
TnTTntelligent Agent Coordinator~2'580 of FIG. 25 is also 
the user's "interface" to the system, in that whenever the 
user interacts with the system, regardless of the GUI or other 
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end-user interface, they are ultimately dealing with (asking 
questions of or sending commands to) the Intelligent Agent 
Coordinator. The Intelligent Agent Coordinator has four 
primary responsibilities: 1) monitoring user activities 2) 
handling information requests, 3j maintaining each user's 
pl'Oflle, auU 4\ luuliug iUJSJrmation to and from users and to 
and from the oTEeTTes£ ^-|iYf> flgent*^ ' - 

Monitoring User Activities 

Anytime a user triggers a sensor the Intelligent Agent 
Coordinator receives an "environmental cue." These cues 
not only enable the Intelligent Agent Coordinator to gain an 
understanding where users' are for information delivery 
purposes, but also to learn the standard patterns (arrival 
time, departure time, etc.) of each persons* life. These 
patterns are constantly being updated and refined in an 
attempt to increase the system's intelligence when deliver- 
ing information. For instance, today it is not uncommon for 
a person to have several email accounts (work-based, home- 
based, mobile-based, etc.) as well as several different com- 
puters involved in the retrieval process for all of these 
accounts. Thus, for the Intelligent Agent Coordinator to be 
successful in delivering information to the correct location it 
must take into account all of these accounts and the times 
that the user is likely to be accessing them in order to 
maximize the probability that the user will see the informa- 
tion. This will be discussed further in another section. 
Handling Information Requests 

The intelligent Agent Coordinator handles information 
requests from other agents in order to personalize informa- 
tion intended for each user and to more accurately reflect 
each user's interests in the information they are given. These 
requests will commonly be related to the user's profile. For 
instance, if an agent was preparing a traffic report for a user 
it may request the traffic region (search string) of that user 
from the Intelligent Agent Coordinator. All access to the 
user's profile data is accessed in this method. 
Maintaining User Profiles 

User profiles contain extensive information about the 
users. This information is a blend of user-specified data and 
information that the Intelligent Agent Coordinator has 
learned and extrapolated from each user's information and 
activities. In order to protect the data contained in the 
profiles, the Intelligent Agent Coordinator must handle all 
user information requests. The Intelligent Agent Coordinator 
is constantly modifying and updating these profiles by 
watching the user's activities and attempting to learn the 
patterns of their lives in order to assist in the more routine, 
mundane tasks. The Intelligent Agent Coordinator also 
employs other agents to glean meaning from each user's 
daily activities. These agents mine this data trying to dis- 
cover indications of current interests, long-term interests, as 
well as time delivery preferences for each type of informa- 
tion. Another important aspect of the Intelligent Agent 
Coordinator's observations is that it also tries to determine 
where each user is physically located throughout the day for 
routing purposes. 
Information Routing 

Most people are mobile throughout their day. The Intel- 
ligent Agent Coordinator tries to be sensitive to this fact by 
attempting to determine, both by observation (unsupervised 
learning) and from cues from the environment, where users 
are or are likely to be located. This is certainly important for 
determining where to send the user's information, but also 
for determining in which format to send the information. For 
instance, if a user were at her desk and using the web client, 
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the Intelligent Agent Coordinator would be receiving indi- 
cations of activity from her PC and would know to send any 
necessary information there. In addition, because desktop 
PCs are generally quite powerful, a full-featured, graphically 

5 intense version could be sent. However, consider an alter- 
native situation: the Intelligent Agent Coordinator has 
received an indication (via the keycard reader next to the 
exit) that you have just left the building. Minutes later the 

10 Intelligent Agent Coordinator also receives notification that 
you have received an urgent message. The Intelligent Agent 
Coordinator, knowing that you have left the building and 
having not received any other indications, assumes that you 
are reachable via your handheld device (for which it also 

15 knows the capabilities) and sends the text of the urgent 
message there, rather than a more graphically-oriented ver- 
sion. 

Inherent Innovations 

20 

The Active Knowledge Management system represents 
some of the most advanced thinking in the world of knowl- 
edge management and human computer interaction. Some of 
25 the primary innovations include the following: 

The Intelligent Agent Coordinator as illustrated above. 

The development, demonstration, and realization of the 
theory of Intelligent Information Delivery 

30 

Support for several channels of information delivery, all 
of which utilize a common back-end- For instance, if a 
user is in front of a Magic Wall the information will be 
presented in a multimedia-rich form. If the system 
35 determines that the user is mobile, the information will 
be sent by to their Awareness Machine in standard text. 
It facilitates delivery of information whenever and 
wherever a user requires the information. 

ersonalization of information based not only o n a static 
user profile, b ut also by taking into account history of 
the user interactions and current real-time situation 
including "who, where, and when" awareness. 
Utilization of fast and scalable Information Prioritization 
Subsystem that takes into account Intelligent Agents 
Coordinator opinion, user preferences, and history of 
user interactions. It takes the load of mundane deci- 
sions off the Intelligent Agents part therefore allowing 
the agents to be much more sophisticated and precise 
without compromising the system scalability. 
Speech recognition and speech synthesis in combination 
with intelligent agent animated representation and tac- 
tile input provides for efficient, intuitive, and emotion- 
ally rewarding interaction with the system. 



Supporting Code in Accordance with a Preferred 
60 Embodiment 

The following code is written and executed in the 
Microsoft Active Server Pages environment in accordance 
65 with a preferred embodiment. It consists primarily of 
Microsoft Jscript with some database calls embedded in the 
code to query and store information in the database. 



PK 
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Intention-Centric Interface 



Create an [listen Lion ASP PAGE £"intention_crcate.asp") 



<%@ LANGUAGE « "JScript" %> 
<% 

Response. Buffer - true; 
Response. Expires = 0; 
%> 

<html> 
<head> 

<tiUe>Create An Intention </title> 
</head> 

<body bgcolor="#FFE9D5" stylc="font-femily: AriaT tcxt="#000000"> 
<% 

//Define some variables 

upl - Seiver.Cre^Ob]ect( <, SoftArtisans.FileUp") 

intention came = upl. Form("intention name") 

intention_desc - up 1 . Form( u intention desc") 

//intention_name = Request Form ("inlention_name") 

//intention_desc = Request Fonn( - inlention_desc") 

//intention_icon - RequestForm("intention_icon") 

submitted - upl.Form^submitted") 

items = new Enumerator(upl.Form) 

%> 

<% 

//Establish connection to the database 

objConnection - Server.CreateObject("ADODB.Connection'') 

objCon nection. Opcn("Maels trom*^ 

%> 

<% 

//Check to see if the person hit the button and do the appropriate thing 

if (submitted = "Add/Delete") 

{ 

flag - "false" 

//loop through all the inputs 
while(!items.atEnd( )) 
{ 

i » items.item( ) 

//if items are checked then delete them 

iffupl .Form(i) — "on") 

{ 

objConnectioQ.Execute(** delete from user_intention where intention id =" 

+ 0; 

obj Co nnection.Execute(" delete from intentions where intention_id =" + 

objConnection.Execute(" delete from tools_to_intention where 
intcntion_id =" + 1) 

flag = "true" 

} 

items.movcNext( ) 

} 

// if items were not deleted then insert whatever is in the text field in the database 

if(flag — "false") 

{ 

intention_name_short - intention name.replace(/ /gi," ") 

objConncction.Executc( w INSERT INTO intentions 
(intenuori__name4ntention_desc,intention_icon) values(*" +- intention__name +"\ *" + 
intentioa__desc + "',"" + intention name short + ".gif" + '")**) 

Response. write(" the intention short name is ** + intention name short); 

upl.SaveAs("E:deve]opment/asp_examplesr+ interjtioa_riame_short +".gif") 

} 

} 

// Query the database to show the most recent items. 

rsCustomerslist ° obj Co nn ecuo n. Execute ("SE LECT * FROM intentions") 

%> 

<input type="Submit" name»"return_to_mcp" value="Go to Main Control Panel" 
onclick=" location, href =»* defaulLasp"'> 

<form method-"post" action-"intention_create.asp" enctype-"muItipart/form-data" > 
<TABLE bordcr=0> 

<trxtd colspan="2"><font facea"Arial" size="4-l"xb> Enter in a new 
inte ntion </b> </f ont> </td xj\x > 

<tr><tdxfont face="Arial">Name:</font></td> <ld><INPUT TYPE="text" 
name="intention_name"x/td> </tr> 

<tr><td> <fo nt face-"Arial">Description: </font><^tdxtd> <TEXTAREA 
n a mc°" i n te ntion_d csc"></TEXTAR EA> </td></tr> 
size°40> </td></tr> 

<tr><td colspan-"2"><INPUT type- u submit" name-**submitted" value-" Add/Delete"><^td></tr> 
</TABLE> 
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-continued 



Create an I retention ASP PAGE ("intention_create.asp") 



<HR> 

<font face="Ariar size="+l"><i»Curreal Intentions </b></font> 
<TABLE> 

<tr bgco!or-E69780 align-"center"> 

<td> 

<FONT color="white">Delete</FONT> 
</td> 
<TD> 

<FONT colo r»"wh ite" > Ite ntio n </FONT> 
</TD> 
<TD> 

<FONT color« 1 Vhite">DescriptiDn</FONT> 
</TD> 
<TD> 

<FONT coloro"white">Image</FONT> 
<^TD> 
<Ar> 

<% 

// Loop over the intentions in the list 
counter - O, 

while (!rsOistomersList.EOFO 
{ 

%> 

<tr bgcolor="white" style~"font-size: smaller"> 
<td align=>cenler> 

<INPUT typc-"chcckbox" name»"<%-=rsCustomerslist("intention_id")%>"> 
<JTD> 
<td> - ■ 

<%- 13 Custo me rsList(" intention _name")%> 
</td> 
ctd> 

<%- rBCustomersList("intention_desc")%> 

</td> 

<img src-".yimages/<%- rsCustomersU£t("intention _icon")%>"> 
</td> 

</tr> 

<% 

counter-M- 

rsCustomerslistMoveNext( )} 
%> 

</TABLE> 
<hr> 

Available Tbols 
</form> 
</BODY> 
</HTML> 



Retrieve [ntentions list ASP Page ("intentions_lisLasp") 



<!— #include file="include/check_authentication.inc" — > 

<HTML> 

<HEAD> 

<nTLE>mySiteI Intentions LIST</nTLE> 
<SCRIPT LANGUAGE- u JavaScript"> 
function tntentionsList () { 

thisinternalAnay = new Anay( ); 
<% 

If establish connection to the database 

objConnection = Server.CreateObject("ADODB. Connection"); 

objConnection.Open("Maelstrom"); 

// create query 

intentionsQuery - objConnection.Execute("SELECT.*.FROM intentions ORDER BY 
intention_name asc"); 
%< 

// write out the options 

<% 

numOptions = 0 

while (! intentionsQuery. EOF) { 

intentionName - intentionsQuery( w intention_name M ); 

intentionlcon = intentionsQueryC**intention_icotf T ); 

%> 
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-continued 



Retrieve Intentions list ASP Page C*intentions_listasp") 

this.internalAiray[<%- numOptions%>] - new Array(2); 
lhisinteraalArrav[<%= numOptions%>IO] «» "<%» intention Name %>"; 
Lhis.internalArrayt <%= numOptions%>Il] - "image intentionlcon 

<% numOptions++; intentionsQuery.moveNext( ); %> 

<% } %> 

} 

numlntentions = <.%=> numOptions%>; 

inLcn Lion Array = new intestionsList( ).internalArray; 

function selectlntention ( ) { 

for (i=0;i<numIntentions;i++) { 

if (IntendonslistSelecLoptions[i} selected) { 

uitentioriNameTextFiel (Lvalue - intentionArray[i][0]; 
//uitentianPicturc.src = intentionArray[iIl£ 
break; 

} 

} 

} 

</SCRIPT> 
</HEAD> 

<BODY BG001X>R="<%^ssion("irmin_backgroand w )%>" style=" font-family: Ariar> 
<CENTER> 

<!— <FORM NAME- <i intention_list"> — > 

<TABLE FRAMED BOX'* border=0 CELLPADDING="2" CELLS PACING="2"> 

<TR><TD COLSPAN="3" STYLE=**font: 20pt a rial" ALIGN="CENTER"><B>Add a mySite! 

Intention</B>^rD > <[YR> 

<TR><TD OOLSPAN="3"> </TD></rR> 

<TR> 

<TD width-100"><font size-"-l">Please Select An Intention You Would Like to Add to 
Your List</font></TD> 
<TD colspan=2> 

<SELECT ID-"IntentionsListSelect" NAME-"IntentionsListSelecr SIZE-"10" 
style="font: 9pt Arial;" onClick^selectlntentiont )"> 
<% 

intentionsQuery.moveFirst( ); 
for(j=0J<numOption5ij-i-+) { %> 

<OPTION VALUE="<%= intentionsQuery( M intention_id") %>" <% if (j = 0) { 
%> SELECTED <%} %» 

<%= intentions Qucry("intention name") %> 

<% inlentionsQuery.moveNext( ) 

} 

intentionsQuery.moveFirst( ); 
%> 

</SELECT> 
</TD> 

</TR> 

<TR><TD COLSPAN-"3"> <AT)></TR> 
<TR> 

<TD widths'* I00"><font size="-l">Custoinize the Intention name</font></TD> 
<TD COLSPAN-2"xINPUT TYPE»"text" NAME="intentionNameTextField" 

ID-"intentionNameTcxtField" SIZE="30" VALUE-" <%- intentionsQuery("intention_name") %>">^TD> 

</TR> 

<TRxTD COLSPAN="3"> </rD></TR> 
<TR> 

<TD COLSPAN="3" ALIGN='"CENTER"> 

<INPUT TYPE="button" NAME="intentionOKButton" VALUE=" OK " SIZE="10" 
ID-"intentionOKButton" onClock-"javaScript: top. opener. top.navframe.addAnIntention( );"> 

        &nbsp ;    &ntep;&ntep;  &ril^;&ritep;  
<INPUT TYPE="button" NAME="intentionCancelButton" VALUE="Cancer SIZE=*"10" 
ID-"intentionCancelButton** onClick- < *seIf.close( );"> 
</TD> 

</TR> 

</TABLE> 

<!-- <FORM> — > 

</CENTER> 

<% obj Connection. CIose( ); %> 

<^BODY> 

</HTML> 
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Display User Intention list ASP Page (excerpted from **navigauon.asp") 

<DIV ID-"intentionIist" style-"posiaon: absolute; width ^10; height:95; left 365pt; top: -5; 
visibility: hidden; font-family: Arial; font-color: #000000; foot: 8pt Arial ; " > 
<DIV style="position: absolute; top:7; left:7; height :78; width:210; z-index:2; background: 
<%-Session( w main_bactground")%>; border: solid Ipt #000000; padding: 3pt; overflow: auto; 
alink: black; link; black;"> 

cbody LINK^"#00000(r AUNK="*OCOOOCT vlinko-black"> 
<% 

II create query 

intentionsQuery ° ob j Co n nectio n. Execute (** SE LECT user_btention-* FROM 

user_intention, user_intention to persona WHERE user__intention to_persona.user_persona id 

+ Sess io n ("cu rrcn t Use r Pe rsona' ') + " AND user_intcntion to_persona.user_intcntion id = 

user„intention.user_inlention_td" ); 

numintentions - 0; 

Responsc.Write("<SCRIPT>numintcntions*»'' + in tentins Query. RecordCount + 
44 </SCRI PTxTABLE cellpadding-'O' width='100%* cellspacing='OV}; 
while (! intentionsQuery. EOF) 
{ 

%> 

-cTRxTDxa href="java$dipt:changeIntention(* <%- 
intentionsQuery("user_intention_id'*) %>','<%-numintentions%>')" onmouseover» w inouseOverTab( )" 
onmouseout»"mouseOutOfIab( )"xfont colop»"Black" face="ariaT size="-2"><%= 
intentionsQuery ("in tention__custom__name") %></font></a></TD><TD><IMG align»"right" 
SRO"images/deIete.gif ' alt-" Delete this intention" onClock="oonfirmDcletc(<%- 
intentionsQuery("user_intention_id'*) %>)"></TD><yTR> 

<%numintentions++; intentionsQuery.moveNext( ); %> 

<% } 

Respoiise.Write("<SCRIrT , >numintemions= , VnuininteQtioQS +"</SCRIPTV T ); 

' %> 

<tr><td cobpan-"2"xhr><ytd></tr> 

<TRxtd colspan="2"xa href="javascriptxhangeIntention('add 
. . /,<%=nununtentions%>);" on mouseover^ mo use OverTab( )" onmouseout="mouseOutOfTab( )"xfont 
color-"Black" face-"arial" size-"-2">add . . .<Jtonl><J&><ftd><fnL> 

</tablc> 

«/body> 
</DIV> 

<DIV style <"position: absolute; top:0; left:-5; width: 230, height:! 05; z-index:l; " 

onmous^out="intentionliststyle.visibility=»*hidden" T 

o nmouseout-" intentionlisL style .visibility-' hidden"* 

o nmouscove r= u intcntio nl is Lstyle.visib ility=' hidden <JDW> 

</DIV> 

</DlV> 



ILink System & 

An example in accordance with a preferred embodiment* 
will assist in teaching one of ordinary skill in the art to make 
and use the invention without undue experimentation. Imag- 
ine a user browsing through the pages of a magazine when 
she sees an ad for a nice OMEGA wristwatch. She remem- 
bers that her boyfriend recently mentioned his interest in 
obtaining a new watch. Because she still doesn't have a 
present for his upcoming birthday she decides it would be a 
good idea to have a closer look at this watch. She looks at 
the lower right corner of the page and notices the well 
known iLink logo. FIG. 27 illustrates a user reviewing a 
magazine containing an iLink logo in accordance with a 
preferred embodiment. The iLink logo 2700 is located in the 
lower right hand corner of the magazine advertisement 
2710, 

FIG. 28 illustrates a user utilizing an iLink device to read 
a barcode in accordance with a preferred embodiment. The 
user uses a hand held computer 2800, such as a Personal 
Device Assistant (PDA) to scan the iLink barcode 2810 and 
after a few seconds the device pops up a web browser, 
showing information about the OMEGA Speedmaster watch 
in Valery's preferred language. She also recognizes an offer 
saying that if she decides to buy immediately on-line, she 
would get a 10% rebate and free delivery. Even more 
important the screen tells her that the watch is available for 
delivery and would reach her within three days — right in 
time for ber friend's birthday. 



Qj By simply selecting the Buy! button she purchases the 

^ watch. The relevant information for this transaction is auto- 
matically passed from her device. The Mobile Data iLink 
project provides heretofore unknown synergy between paper 
and electronic media that assists in attracting and retaining 

45 customers. With their hand held computers, customers can 
access detailed, pertinent and timely information by scan- 
ning an iLink — whether the barcode is printed in an 
advertisement, in an article, on a box, poster, leaflet or even 
on a product. One of ordinary skill in the computer art will 

so readily comprehend that Optical Character Recognition 
(OCR) equipment can be readily substituted for the barcode 
information without detracting from the claimed invention. 
Customers can use a standa rd interface th ey ar e familiar 
wit5"to get immediate feedback that is dynamic, p ersonal- 

55 ized ana pushed through the Web to the customer's browser. 
If a user scans a watch ad in Wired Magazine versus 
someone scanning the same watch add in Forbes Magazine. 
Tie information that comes to these two people would be 
different, even though the ad was the same. The information 

60 would be formatted and include vocabulary selected to 
appeal to a reader of the magazine based on statistical 
analysis of target populations. iLinks can be incorporated 
into anything printed. In a store customers can scan the 
codes on a product's packaging to read more about it or see 

65 competitor information. A newspaper or a magazine reader 
can scan the barcodes provided on the pages to obtain 
current, detailed information utilizing a network connection 
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such as the Internet — whether this is from the paper's own better picture of their target audience, every customer scan- 
site or from advertiser's web pages. ning a barcode will inform the advertiser when, where and 

Advertisers get a better picture of their target audience, at what time a publication actually triggered a reaction, 

every customer scanning a barcode will inform the adver- PDAs provide you with information you'd like to know— 

user when, where and at what time a publication actually 5 wherever and whenever you scan an iLink. Corporations 

triggered a reaction. PDAs provide you with information today are focused on merging or extending publications on 

you'd like to know — wherever and whenever you scan an traditional media with electronic media. Until now, most 

iLink. Corporations today are focused on merging or extend- have failed in finding a way to reach actual synergy between 

ing publications on traditional media with electronic media. both media types. iLink utilizes novel technology to: 

Until now, most have failed in finding a way to reach actual 10 Provide a service to differentiate from the competitors 

synergy between both media types. iLink is a concept that Improve Customer Relationships with increased customer 

shows how to use emerging technology to: interaction, thus attracting new customers and retaining 

Provide a service to differentiate from the competitors old customers 

Improve Customer Relationships with increased customer Reduce printing costs 

interaction, thus attracting new customers and retaining 15 , ncrease market knowledge 

o customers Reduce product shipping delays due to manual translation 

Reduce pnnting costs and printing delays 

Increase market knowledge Tailor information to fit the customer 

Reduce product shipping delays due to manual translation ~ n , . ^ , . 4 . . . . 

and rintin dela Replace printed maintenance manuals with real-time 

t - . - , up-to-date language tailorable information 

Tailor information to fit the customer A , f r , . 

„ . . , , . , , ... , Add services on top of products 
Replace printed mainte nance manuals with real-time 

up-to-date language tailorable information Details in Accordance with a Preferred 
Add services on top of products 25 Embodiment 
Valery is sitting in a street cafe and reading an English _^ . ... , , wm 
color ma azine The iLink device utilizes some new barcode content (IP 
co or magazine. address+metainformation embedded in the barcode), bar- 
As she browses through the pages she sees an ad for a nice , _ _ . f , „ . . « / .' 
OMEGA wristwatch. She remembers that her boyfriend ^! /I ^ anner ' PDAfratapilot), a web browser, a wueless 
recently mentioned his favor for this watch. Because she still 30 ™ P connection. These technologies exist today however 
, ,;, t c u . - ... , « » - , in separate components which we have integrated into our 
doesn t have a present for his upcoming birthday she decides * ™ t_- a. c *ui 

. , , j.j . , , i i » +u - . u working prototype. The combination of these four technolo- 

lt would be a good idea to have a closer look at this watch. . „ &r , J . r , . «™ 4 v x , „ . t 

She looks at the lower right corner of the page and notices ^s (barcode, barcode reader, (PDA) patapilot & wireless 

, „ . -T • i i data) exists today, however the unique use ot these nve 

the well known iLink logo. L ' . . J * TT , , A . - n . . . , 

A . u * i * u t • 1 a *™ u , e technologies plus the IP and metainiormation m the barcode, 

At once she takes out her llink device, scans the iLink 35 <• At i m • c ** * * 

i_ . j & r j*uj- ™ u and the addition of the personal profile intormation lnte- 

barcode and after a few seconds the device pops up a web . , 4 • u -i- 4 

, , . . c t . i_ « *t_ niicPA c a grated with the web browser creates a new unique capability, 

browser, showing information about the OMLGA Speed- & • ■ 

master watch in Valery's preferred language. She also rec- *f> A preferred embodiment id accordance with the invention< 

ognizes an offer saying that if she decides to buy immedi- ^ utillzes software (C code we developed) which takes the IP 

ately on-line, she would get a 10% rebate and free delivery. 40 addrcss and tbe additional meta-information (passed from 

Even more important the screen tells her that the watch is the integrated barcode reader of the Symbol device) together 

available for delivery and would reach her within three with the local ilink application's personal profile informa- 

days— right in time for her friend's birthday. tion wnicn 15 configured by the consumer/user of the iLink 

By simply selecting the Buy! button she purchases the device » ^ P arses out IP address from the number stnn S 

watch. The relevant information for this transaction is auto- 45 * * P 355 ^ building an IP address and Universal Resource 

matically passed from her device. A preferred embodiment Lmk (URL)/path string which it then passes to the locaU^b 

demonstrates bow the synergy between paper and electronic browser which connects to aserveron the fatemetfor 

media can help to attract and retain customers. With their InTrinjffw^fr as itjs^iassed 

PDA's customers can access a large amount of up-to-date $y the browserrand-sends bacFurnque information to the 

information at the moment they scan an ilink— whether the so device— which is targeted to the customer's profile, 

barcode is printed in an advert, in an article, on a box, poster, the ad wa s scanned, the magazine that was scanned, and 

leaflet or even on a product. Customers can use a standard otner pertinent information. 

interface they are familiar with to get immediate feedback If a user was browsing through a service manual on the 

that is dynamic, personalized and pushed through the Web to copying machine in an effort to locate relevant information 

the customer's browser. 55 to repair the machine and found out that the explanation is 

An example of the targeted information would be if out of date with the actual product, and the document has 

someone scans a watch ad in Wired Magazine versus some* some words and expressions that are confusing since 

one scanning the same watch add in Forbes Magazine. The English is not the user's native tongue, then the user can pick 

information that comes to these two people would be up an ilink device, point it at the iLink logo on the copying 

different, even though the ad was the same. 60 machine and hit the ilink button. On the screen a standard 

An iLink logo can be incorporated into anything printed. web browser shows a webpage in the user's native language 

In a store customers can scan the codes on a product's that provides up to date information that was not in your 

packaging to read more about it or see competitor informa- printed manual, and suggests telephone contacts for experts 

tion. A newspaper or a magazine reader can scan the in the type of repair you are about to do. 

barcodes provided on the pages to get up to date or in depth 65 FIGS. 29 to 37 depict a handheld computer with screen 

information via the web—whether this is from the paper's displays in accordance with a preferred embodiment. A user 

own site or from advertiser's web pages. Advertisers get a interacts with the displays to select tbe target scannable 
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idicia and inpul it into a web directed query to facilitate the target item and the verbal summary are sent to a user 

description and/or purchase of the target item. FIG. 38 device utilizing a wireless communication link, 

depicts the architecture and process flow in accordance with u ^ computer program embodied on a computer- 

a preferred emtodimenLAuser selecte rcadab , c medium ^ CTCatcs aQ summarv , 

of products 3310 by pointing a barcode reader attached to a 5 , . 

palm pilot or other computer device 3320 and reads the comprising: 

iCode from the product. The iCode is used to prepare a query (a) a code segment that retrieves an electronic indicia of 

for transmission via TCP/IP or other communication proto- a target item; 

col 3330 to the Internet 3350 to obtain information from a a,) a code segment that creates a query based on the 

third party website 3340. The information is returned tot he An , . ^ • • • 

j . -~~ n c . , . t . io electronic indicia; 

computer device 3320 for use in presenting descriptive . 

information to a user or to allow a user to purchase the target ( c ) a code segment that queries a network of information 

item. utilizing the query; 

While various embodiments have been described above, (d) a code segment that provides the information associ- 

it should be understood that they have been presented by ated with the target item to a user; 

way of example only, and not limitation. Thus, the breadth ( e ) a code segment that determines which of a plurality of 

and scope of a preferred embodiment should not be limited profiles of the user is currently being used; and 

by any of the above described exemplary embodiments, but ^ a ^ segment ma t filters the information based on the 

should be defined only in accordance with the following profile that is currently being used; 

claims and their equivalents. 20 (g) a ^ x&neat mat atA le& summaries of the filtered 

What is claimed is: information; 



1. A method for creating an information summary, com 
prising the steps of: 



(h) a code segment that converts selected portions of the 

. . . . to electronic speech; and 

(a) retrieving an electronic indicia of a target item; ... , . 

v 7 ° ... 25 (i) a code segment that utilizes the electronic speech for 

(b) creating a query based on the electronic indicia; outputting a verbal summary of the filtered information 

(c) querying a network of information utilizing the query; tQ ^ }JSQT 

(d) providing the information associated with the target 12 A computer program embodied on a computer- 
item to a user; readable medium that creates an information summary as 

(e) determining which of a plurality of profiles of the user 30 rcc ited in claim 11, wherein each profile has a unique 
is currently being used; intention associated therewith. 

(f) filtering the information based on the profile that is 13. A computer program embodied on a computer- 
currently being used; readable medium that creates an information summary as 

(g) creating summaries of the filtered information; 35 recited in claim 11, wherein each profile has a unique 

(h) converting the summaries to electronic speech; and address associated therewith. 

(i) utilizing the electronic speech for outputting a verbal 14 A computer program embodied on a computer- 
summary of the filtered information to the user. readable medium that creates an information summary as 

2. A method for creating an information summary as recited in claim 11, wherein each profile has unique restric- 
recited in claim 1, including the step of parsing the elec- tions associated therewith. 

tronic indicia based on predefined criteria to create the 15. A computer program embodied on a computer- 
query readable medium that creates an information summary as 

3. A method for creating an information summary as ^cited in claim 11, wherein each profile has unique business 
recited in claim 1, wherein each profile has a unique 45 ™les associated therewith. 

intention associated therewith. I 6 * A computer program embodied on a computer- 

4. A method for creating an information summary as readable medium that creates an information summary as 
recited in claim 1, wherein each profile has a unique address recited in claim 11, wherein the indicia includes content 
associated therewith. information utilized in tailoring the response to the user. 

5. A method for creating an information summary as 50 17. A computer program embodied on a computer- 
recited in claim 1, wherein each profile has unique restric- readable medium that creates an information summary as 
tions associated therewith. recited in claim 11, including logic that mails the informa- 

6. A method for creating an information summary as non to me user - 

recited in claim 1, wherein each profile has unique business 55 i8 - A computer program embodied on a computer- 
rules associated therewith. readable medium that creates an information summary as 

7. A method for creating an information summary as recited in claim 11, wherein the indicia is a barcode, 
recited in claim 1, wherein the query includes an internet 19- A computer program embodied on a computer- 
protocol address readable medium chat creates an information summary as 

8. A method for creating an information summary as 60 recited in claim 11, including logic that transmits the infor- 
recited in claim 1, wherein the indicia is a barcode. mation by phone. 

9. A method for creating an information summary as 20. An apparatus that creates an information summary, 
recited in claim 1, including the step of purchasing a product comprising: 

utilizing the electronic indicia. 65 (a) a processor; 

10. A method for creating an information summary as (b) a memory that stores information under the control of 
recited in claim 1, wherein the information associated with the processor; 
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(c) logic that retrieves an electronic indicia of a target 
item; 

(d) logic that creates a query based on the electronic 
indicia; 5 

(e) logic that queries a network of information utilizing 
the query; 

(f) logic that provides the information associated with the 
target item to a user; 

(g) logic that determines which of a plurality of profiles of 
the user is currently being used; and 



2B1 
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(h) logic that filters the information based on the profile 
that is currently being used; 

(i) logic that creates summaries of the filtered informa- 
tion; 

(i) logic that converts the summaries to electronic speech; 
and 

(k) logic that utilizes the electronic speech for outputting 
a verbal summary of the filtered information to the user. 

***** 
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